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An  experiment  in  which  the  treatments  are  compared  and  ranked 
pairwise  is  called  a  paired  comparison  experiment.   The  Bradley-Terry 
model  for  preference  probabilities  with  ties  not  allowed  is  used  in 
this  dissertation.   This  model  defines  treatment  parameters,  tt  ,  ...  , 
7T  ,  such  that  the  probability  that  treatment  T.  is  preferred  over 
treatment  T.  is  equal  to  tt.  (tt. +Tr . )   .   l-Then  the  treatments  are  levels 
of  continuous,  quantitative  variables,  the  logarithm  of  the  Bradley- 
Terry  parameters  can  be  modeled  as  a  regression-type  model , 

InTT .  =  'iS,  X,  .  .   There  have  been  a  large  nvimber  of  papers  on  the  topic 
1   ^  k  ki 

of  paired  comparisons ,  but  only  a  few  have  considered  experimental 
design.   Past  papers  on  design  are  reviewed  in  Chapter  1.   In  1973 
Springall  presented  the  asymptotic  distribution  of  the  maximum  likeli- 
hood estimators  of  B, ,  ...  ,3  ,  where  s  is  the  number  of  regression- 
1        s 

type  parameters  in  the  model.   Chapter  2  of  the  present  dissertation 
contains  a  derivation  of  this  asymptotic  distribution.   The  remainder 


of  the  dissertation  is  a  consideration  of  designs  for  situations  where 
the  treatments  are  levels  of  a  single  quantitative  variable. 

The  asymptotic  variance-covariance  matrix  is  a  function  of  the 
true  parameter  values.   Hence,  the  optimal  designs  also  depend  on  the 
parameters.   In  previous  papers  on  design,  the  Bradley-Terry  parameters 
were  taken  to  be  equal  when  evaluating  the  variances  and  covariances. 
The  present  dissertation  considers  the  design  problem  for  various 
parameter  values. 

Notice  that  the  general  design  problem  is  complex.   It  involves 
deciding  how  many  levels  and  which  particular  levels  should  be  chosen. 
Furthermore,  it  must  be  determined  how  often  to  compare  each  pair  of 
treatments.   In  some  cases  this  complexity  was  resolved.   In  other 
cases  additional  restrictions  had  to  be  imposed  before  optimal  designs 
could  be  found. 

Chapter  3  considers  designs  which  minimize  the  variance  of  a 
single  parameter  estimate,  S..   The  linear,  quadratic,  and  cubic  models 
are  considered.   The  optimal  design  in  the  linear  case  turns  out  to  be 
comparisons  of  only  the  smallest  level  in  the  experimental  region  with 
the  largest,  for  most  values  of  the  linear  parameter.   The  designs  for 
the  quadratic  and  cubic  cases  depend  more  heavily  on  the  parameter 
values  than  for  the  linear  case. 

Chapter  4  presents  optimal  designs  for  fitting  a  quadratic  model. 
The  optimality  criteria  considered  are  D-optimality ,  the  minimization 
of  the  average  variance  of  Inir  ,  and  the  minimization  of  the  maximum 
value  of  InTT..   These  designs  also  depend  heavily  on  the  parameters, 
although  some  overall  design  recommendations  are  given  in  the  last 
section. 


The  remaining  chapters  contain  a  brief  discussion  of  related  top- 
ics.  Chapter  5  is  a  consideration  of  designs  which  protect  against  the 
bias  present  when  the  true  model  is  cubic.   Oiapter  6  is  a  discussion 
of  designs  for  preliminary  test  estimators.   Chapter  7  is  a  considera- 
tion of  two-stage  sampling.   The  first  stage  is  a  design  which  results 
with  a  small  variance  of  the  quadratic  parameter  estimate.   A  test  of 
hypothesis  then  determines  whether  the  second  stage  design  should  be 
one  which  is  optimal  for  fitting  a  linear  or  a  quadratic  model.   A 
discussion  of  the  best  error  rate  to  use  for  the  test  of  hypothesis  is 
included. 

The  appendices  contain  computer  programs  that  find  maximum  likeli- 
hood estimates  of  the  Bradlev-Terry  parameters  and  6,/  ...  ,B  •   These 

1        s 

programs  are  written  in  the  languages  APL  and  Fortran. 


CHAPTER  1 

DESIGN  OF  PAIRED  COMPARISON  EXPERIMENTS 
A  LITERATURE  REVIEW 


1.1   Introduction 

An  experiment  in  which  the  treatments  are  compared  and  ranked 
pairwise  is  called  a  paired  comparison  experiment.   Such  an  experiment 
requires  a  number  of  siob^jects  which  are  usually  individuals,  but  could 
conceivably  be  a  machine,  for  instance.   Each  subject  is  required  to 
compare  two  samples  and  decide  which  of  the  two  is  preferable  for  the 
attribute  under  study.   For  example,  each  subject  could  be  asked  to 
state  which  of  two  samples  tastes  better.   Paired  comparison  experi- 
ments are  often  conducted  in  areas  such  as  food  testing  where  it  may  be 
difficult  for  an  individual  to  quantify  his  like  or  dislike  of  a  sample, 
but  he  may  be  able  to  readily  decide  which  of  the  two  samples  is  pre- 
ferred. 

Suppose  that  an  experimenter  wants  to  determine  which  of  four 
brands  of  coffee  most  consumers  prefer.   There  are  a  number  of  experi- 
mental procedures  available.   One  possibility  is  that  each  individual 
be  required  to  taste  and  rank  all  four  brands  from  least  favorable  to 
most  favorable.   However,  sensory  fatigue  may  be  a  problem  because 
after  tasting  the  second  or  third  sample,  it  may  be  difficult  to  per- 
ceive any  difference  between  the  s\ibsequent  sample  and  the  first  sample 
tasted. 


Another  possible  procedure  is  to  have  each  individual  assign  to 
each  brand  a  score  on  some  niomerical  scale.   Sensory  fatigue  may  again 
be  a  problem  with  this  experimental  procedure  since  all  four  brands  are 
tasted  by  each  individual.   Additionally,  there  may  be  a  degree  of  ar- 
bitrariness to  choosing  a  numerical  score  for  each  treatment. 

A  third  possibility  is  to  conduct  a  paired  comparison  experiment. 
The  problems  mentioned  in  the  two  preceding  paragraphs  are  not  present 
for  paired  comparison  experiments.   That  is  to  say,  paired  comparison 
experiments  have  a  minimal  amount  of  individual  guesswork  involved. 
As  pointed  out  in  the  first  paragraph,  the  complete  experiment  involves 
a  number  of  individuals ,  each  one  choosing  out  of  two  samples  the  one 
which  is  preferable.   For  the  particular  example  with  four  brands  of 
coffee,  24  s\±)jects  might  be  utilized,  thereby  resulting  in  4  repli- 
cates of  each  of  the  6  distinct  pairs  of  treatments. 

The  treatments  can  have  a  factorial  arrangement.   However,  facto- 
rial paired  comparison  experiments  have  often  been  analyzed  ignoring 
the  factorial  arrangement  of  the  treatments.   For  example,  Larmond, 
Petrasovits,  and  Hill  (1968)  conducted  a  2^3  factorial  paired  compari- 
son experiment,  but  they  did  not  test  for  interaction  or  main  effects 
as  normally  is  done  with  factorial  experiments.   Although  Abelson  and 
Bradley  (1954)  presented  a  theoretical  development,  only  relatively 
recently  have  tractable  methods  been  available  for  testing  interaction 
and  main  effects  in  factorial  paired  comparison  experiments. 

In  the  case  of  quantitative  treatments,  an  analogue  of  multiple 
linear  regression  analysis  is  appropriate.   For  example,  instead  of 
four  distinctly  different  brands  of  coffee,  there  may  only  be  one  brand 


of  coffee  with  four  different  levels  of  an  additive.   The  design  of 
paired  comparison  experiments  for  fitting  response  surfaces  with  one 
independent  variable  is  discussed  in  Chapters  3-7. 

1.2  Bradley-Terry  Model 

Denote  the  t  treatments  as  T  ,T  ,  ...  ,T  .   Let  n    ^  0  be  the 

12        t        ij 

nvimber  of  times  T.  and  T,  are  compared,  i<  j ,  i,j=l,  ...  ,t.   We  write 
T.  -^  T.  for  "T.  is  selected  over  T.",  where  selection  is  based  on  the 
particular  attribute  under  study.   A  general  model  defines  (  )  function- 
ally independent  parameters ,  0  i>  tt  .  £•  1 ,  such  that 


P{T.  ^  T.)  =  IT.  .  ,   IT.  .  +  TT.  .  =  1,   iT^j,  i,j  =  l,.  .  .,t.        (1.2.1) 


Each  distinct  pair  of  treatment  comparisons  is  a  set  of  independent 
Bernoulli  trials.  The  entire  experiment  is  a  combination  of  the  (") 
independent  sets. 

Bradley  and  Terry  (1952)  proposed  a  basic  model  for  paired  compar- 
isons.  A  treatment  parameter  tt  .  is  associated  with  each  treatment  T  , 

1  1 

i=l,  ...  ,t.   The  Bradley-Terry  model  is  then  defined  to  be 


P(T.  ^-  T.)  =  TT.  .  =  Tr./(7T.  +  TT.)   ,    i^^  j  ,  i  ,  j  =  l  ,  .  .  .  ,  t .  (1.2.2) 

The  right-hand  side  of  (1.2.2)  is  invariant  under  scale  changes,  so  a 

single  constraint  is  imposed  to  make  the  treatment  parameters  unique. 

Two  popular  choices  are   Ztt.  =1,  or   z^ln-r.  =0.   This  constraint  is 

1  1 

replaced  with  another  constraint  in  Chapters  2-7. 


Another  model  for  paired  comparisons  was  presented  by  Thurstone 
(1927) .  He  used  the  concept  of  a  subjective  continuum  on  which  only 
order  can  be  perceived.   Let  y .  represent  the  location  point  on  the 

continuum  for  treatment  T. ,  i=l,  ...  ,t.   An  individual  receives  a 

1 

sensation  X.  in  response  to  treatment  T. ,  with  X.  distributed 

1  IX 

Normal (u. ,1) .   The  probability  that  T.  is  preferred  over  T.  is  then 


P(T.  -^  T.)  =  P(X.  >  X.)  =  -^    I  e  ^  /^  dy  ,      ^^^         (1.2.3) 

3        ^     ^     ^J  i,j  =  l t. 

-(!i.-U.) 

1  : 


Bradley  (1953)  noted  that  replacement  of  the  normal  density  function 
in  (1.2.3)  by  the  logistic  density  function  yields 


P(T.  -^  T.)  =1    -sech^(y/2)  dy  =  tt  ./(""■. +1T . )  ,      ^^^  (1.2.4) 

'  ^        J  ^  ^        ^      3  i,j  =  l t. 

-  (InTT.-lnTT .  ) 

1   : 


This  is  the  Bradley-Terry  model  with  u.=lnTT.,  i=l,  ...  ,t. 

Thompson  and  Singh  (1967)  gave  a  psychophysical  consideration  by 
assuming  a  treatment  T  stimulates  unobservable  signals  U  ,  ...  ,U 
which  are  then  transmitted  to  the  brain  by  m  sense  receptors.   The  U. 
are  independent  and  identically  distributed,  and  m  is  taken  to  be  fixed 
and  large.   The  two  variables  considered  for  the  response  X  to  treatment 
T  are 


(i)   X  is  the  average  of  the  signals  U  ,  ...  ,U  , 

(ii)   X  is  the  maximum  of  the  signals  U  .  ...  ,U  . 

1        m 


By  the  Central  Limit  Theorem,  asymptotic  normality  results  for  X  in 
(i) ,  which  results  with  Thurstone ' s  model.   The  random  variable  in  (ii) 
has  one  of  three  distributions  depending  on  the  distribution  of  the  U. . 
If  U. ,  for  example,  is  distributed  exponentially,  then  the  asymptotic 
distribution  of  X  is  the  extreme  value  distribution.   In  any  case,  how- 
ever, the  Bradley-Terry  model  in  (1.2.4)  results  from  (ii) . 

Rao  and  Kupper  (1967)  generalized  the  Bradley-Terry  model  to  allow 
for  ties.   A  tie  parameter  9  ^  1  is  introduced,  and  the  model  becomes 


P(T.  ^  T.)  =  I    i  sech^(y/2)  dy  =  IT ./ (TT. +011 . )  ,       ^^^ 


i,j=l,...,t, 


(InTT.-lnTT.  )+ri 
1    D 


-(IniT.-lmT  J+n 

1     D 


1      2 
p(T.  =  T.)  =  T  sech  (y/2)  dy  (1.2.5) 


3 


4 


i, j=l, . . . ,t, 


-(InTT.-lnTT  J-n 
1     3 


(8^  -  Dtt.tt. 

1  D 

(TT.  +  077.)  (0Tr.  +  IT.: 

1    :   1   : 


where  ri=ln0  is  the  threshold  of  perception  for  the  judges.   That  is  to 
say,  if  it  is  hypothesized  that  the  two  samples  generate  a  random  vari- 
able d  which  measures  the  difference  between  the  samples,  and  further- 
more that  |d|  <  Ti ,  then  the  judge  will  not  be  able  to  discern  a  differ- 
ence between  the  two  samples,  and  will  thus  declare  a  tie.   Note  that 
the  Bradley-Terry  model  is  a  special  case  with  9=1.   Another  model  to 
handle  ties  was  proposed  by  Davidson  (1970)  , 


The  Bradley-Terry  model  has  received  much  attention  in  statistical 
literature  since  it  was  introduced  in  1952.   For  the  remainder  of  this 
dissertation,  the  Bradley-Terry  model  with  ties  not  allowed  is  used. 

1.3   Estimation  of  the  Bradley-Terry  Parameters 
and  Corresponding  Asymptotic  Distribution 

When  the  model  was  proposed  by  Bradley  and  Terry,  it  was  assumed 
that  all  of  the  n. .  were  eqpaal.   Dykstra  (1960)  extended  the  method  to 
permit  unequal  n. .. 

The  parameters  are  estimated  by  the  maximum  likelihood  method  and 
likelihood  ratio  tests  are  developed.   Assuming  independence  of  the 
paired  comparisons,  the  complete  likelihood  function  is 


t   a.     t  n.  . 

L   =    K  TT.  ^  /   n  (TT.  +  TT.)   ^^   ,  (1.3.1) 

i=l  "      i<j  '     ^ 


where  a.  is  the  total  number  of  times  T.  is  selected  over  any  other 
1  1 

treatment,  i=l,  ...  ,t.   The  likelihood  equations  are 


a.      r— 1    n.  , 

—  -  y  — ^ 

p.     Z_j  (P,  +  P 


3 


.  ) 

1    ] 


t 


=   0  ,  i=l, . . . ,t. 


(1.3.2) 


Z^  = 


1  , 


i=l 


where  p.  denotes  the  maximum  likelihood  estimate  of  :r .  ,  i=l,  ...  ,t. 


These  equations  must  be  solved  iteratively  (see  Appendix  A  for  an 
APL  computer  program  which  finds  maximum  likelihood  estimates  of  the 
treatment  parameters) .   A  brief  description  of  the  iterative  procedure 
follows .   Letting  p .     be  the  k   approximation  to  p . ,  then 


(k) 

Pi 


*(k)  ,  V"   *(k)  .,  .  ,. 

=  p^    ^  /,   i     '  (1.3.3) 


i=l 


where 


i.  /   >    n.  ./(p. 

1   ZIj  L  i:   1 


p.      =   a.  /   >    n.  ./(p.       +  p . 


,  k=l,2,- ••.  (1.3.4) 


: 

The  iteration  can  be  started  with  p.    =l/t,  i=l,  ...  ,t.   Dykstra  (1956) 
suggested  a  method  of  obtaining  good  initial  parameter  estimates  p.    , 
i=l,  ...  ,t. 

Ford  (1957)  proposed  the  model  independently  and  proved  that  the 
iterative  procedure  converged  to  a  unique  maximxrai  for  L  if  the  following 
assumption  is  true. 

Assumption  1.1.   For  every   possible  partition  of  the  treatments  into 
the  two  sets  S   and  S  ,  some  treatment  in  S   is  preferred  at  least  once 
to  some  treatment  in  S  . 

If  Assiomption  1.1  does  not  hold,  then  a.  must  be  zero  for  at  least  one 

i.   If  exactly  one  a.  is  zero,  say  a.  ,  there  may  still  be  a  unique 

o 

solution  with  p.  =0.   However,  Ford  proceeded  to  explain  that  if  the 
o 

set  S   which  violates  Assumption  1.1  contains  two  or  more  treatments, 
then  the  corresponding  estimates  of  the  Bradley-Terry  treatment 


parameter  must  be  zero,  and  consequently  individual  members  of  S   could 

not  be  compared.   This  fact  is  also  evident  by  noticing  that  in  (1,3.4) , 

*  (k) 
p.    would  be  zero  for  at  least  two  values  of  i,  and  so  by  (1.3.3), 

(k) 
p.     would  also  be  zero  for  the  same  values  of  i.   Then  the  next  time 

in  the  iterative  procedure  that  (1,3.4)  is  executed,  the  denominator 
in  the  summation  would  be  zero  for  some  i  and  j ,  and  hence  the  itera- 
tive procedure  would  not  converge , 

The  asymptotic  theory  and  tests  of  hypothesis  require  the  follow- 
ing additional  assumption. 

Assumption  1.2.   For  every  partition  of  the  treatments  into  two  non- 
empty subsets  S,  and  S^,  there  exists  a  treatment  T.eS,  and  a  treatment 
12  1   1 

T.oS^  such  that  U. .>0,  where 
:   2  13 


y^   =   lim  — -^  ,     ij^j,  i,j=l, 1, 


N  = 


=  Z  Z ".. 


Bradley  (1955)  investigated  asymptotic  properties  of  the  treatment 
parameters  with  each  n. ,=n.   Davidson  and  Bradley  (1970)  considered  a 
multivariate  model  where  each  subject  chooses  one  of  two  samples  on  more 
than  one  attribute.   As  a  special  case  of  the  multivariate  model,  David- 
son and  Bradley  obtained  a  more  general  result,  allowing  the  n. .  to  be 
different.   They  showed  that  the  asymptotic  joint  distribution  of 
v''N(p  -TT  ),  ...  ,i'N(p  -T7  )  is  the  singular  multivariate  normal  distribu- 
tion of  dimensionality  (t-1)  in  a  space  of  t  dimensions,  with  zero  mean 


vector  and  variance-covariance  matrix  S  =  (a  . ) ,  where 


O.  .      =   cof actor  of  A . .  in 
13  13 


'hj^    txt     i  txl 


i'lxt 


^^ij^  txt     i  txl 


i'  ixt 


(1.3.5) 


1_'      =      (1»1,  ...  ,1),  the  t-dimensional  unit  row  vector,  and 


X.  . 
11 


^  ^    ^^   (71.  +  1 


3 


(IT.  +  IT  .) 
1     D 


2   ' 


i=l,...,t, 


^j   =   -^ij'^^^i  ^  ^j^    ' 


Ly^j,    i,j=l,...,t. 


It  is  apparent  that  the  variances  and  covariances  in  (1.3.5)  depend  on 

the  true  treatment  parameters.   Hence  estimates  of  the  variances  and 

covariances  are  usually  found  by  substituting  the  consistent  maximum 

likelihood  estimates  for  tt  ,  ...  ,7T   into  (1.3.5). 

In  the  special  case  with  7T.=l/t,  n.  ,=n  for  all  i,i, 

1       x: 


a. ,   =  2(t-l)^/t^  ,   and  a. . 
11  1: 


■2(t-l)/t   ,   It^j.       (1.3.6) 


Use  of  (1.3.6)  is  adequate  if  IT    ...  ,71  are  approximately  equal. 


10 


The  major  test  proposed  is  a  test  of  treatment  equality, 


"o=   ^  =  ^2  =  •■•  =  \   =   ^/^  ' 


H  :   TT.  7^  7T.  ,   for  some  i,j,  i?^  j ,  i,j=l,...,t. 
a    1    J 


The  likelihood  ratio  statistic  is 


-21nA   =   2Nln2  -  2 


E  E  "ij'^^VPj^  -  E  'i'"  ^i 


^  i<j 


Under  the  null  hypothesis,  H  ,  -21nA  is  asymptotically  central  chi- 
square  with  (t-l)  degrees  of  freedom.   Bradley  and  Terry  (1952)  and 
Bradley  (1954)  provided  tables  for  t=3,4,5,  including  exact  signifi- 
cance levels.   Comparison  of  the  chi-square  significance  levels  with 
the  tabled  exact  significance  levels  suggests  that  the  former  may  be 
used  even  for  relatively  small  values  of  n, ..   This  is  perhaps  compar- 
able to  using  the  normal  approximation  to  the  binomial. 

The  asymptotic  distribution  under  the  alternative  hypothesis  is 
also  available  for  -21nA.   Let 


TT.  =  —  +  ,      > 


5.   =  0  ,   lim  6.   =5. 
iN  iN    1 

1=1 


Then  -21nA  is  asymptotically  noncentral  chi-square  with  (t-l)  degrees 
of  freedom  and  noncentrality  parameter  X  ,  where 


^  •  dl"^i"i-'i 


i<j 


11 


1.4   Designs  of  Factorial  Paired  Comparison  Experiments 

Littell  and  Boyett  (1977)  compared  two  designs  for  Rxc  factorial 
paired  comparison  experiments.   The  two  designs  considered  are: 

Design  I:   Consists  of  independent  paired  comparisons  of  each  of  the 

RC 
(   )  pairs  of  treatments. 

Design  II :   Consists  of  comparisons  between  pairs  of  treatment  com- 
binations differing  only  in  the  levels  of  one  factor,  i.e.  comparing 
two  treatments  in  the  same  row  or  column. 

RC     1 
Note  that  there  are  (   )  =  — RC(RC-l)  distinct  pairs  of  treatments 

for  Design  I,  but  only  R(S  +  C(  )  =  ^C{R+C-2)  distinct  pairs  of  treat- 
ments for  Design  II.   In  the  4X4  case,  for  example,  Design  I  requires 
120  distinct  paired  comparisons  whereas  Design  II  requires  only  48 
distinct  paired  comparisons.   The  two  designs  could  entail  the  same 
total  number  of  paired  comparisons,  but  Design  II  requires  preparation 
of  fewer  distinct  pairs  of  samples. 

Design  II  is  also  preferable  from  a  computational  point  of  view 
because  its  analysis  can  be  carried  out  by  using  a  computer  program 
capable  of  handling  the  one-way  classification  with  unequal  replication 
of  pairs.   A  specialized  factorial  program  is  required  for  Design  I  to 
obtain  maximum  likelihood  estimates  under  the  main  effects  hypothesis, 
H  :  Ti       =  a.3.,  where  TT .  .  is  the  Bradley-Terry  treatment  parameter 
given  by  (1.4.1). 

The  two  designs  are  illustrated  for  the  2^2  case  in  Figure  1.1. 
The  comparisons  made  with  Design  I  are  indicated  by  the  solid  arrows. 
The  comparisons  made  with  Design  II  are  indicated  by  the  dotted  arrows. 


Factor  B 
low  high 
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low 


Factor  A 


high 


r-^       ,  ,  ,. 

— ^ 

A            / 

[  ^ 

ii         \ 

■^-d 
<j..__ 

t-  — -i^ 

1 

Figure  1.1.   Depiction  of  Designs  I  and  II 
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Designs  I  and  II  were  compared  by  Littell  and  Boyett  on  the  basis 
of  the  asymptotic  relative  efficiencies,  in  the  Bahadur  sense,  of  their 
respective  likelihood  ratio  tests.   That  is,  test  statistics  are  com- 
pared on  the  basis  of  the  ratio  of  the  exponential  rates  of  convergence 
to  zero  of  their  observed  significance  levels.   In  general,  the  Bahadur 
efficiency  of  test  1  relative  to  test  2  is  defined  to  be 


2        (1) 
lim(-  -  log  L  ^    ') 

n->co 


c  f9)/c,(e)   , 


,  .  ,   2  -    ^  (2),        ^l^""^2 
lim( log  L    ) 


where  L     is  the  observed  significance  level  of  test  i.   The  fvinction 
n 

c.  (9)  is  called  the  exact  slope  of  test  i. 

Usually  Bahadur  efficiency  is  used  to  compare  two  test  statistics 
that  are  based  on  the  same  sample  space.   However,  its  use  is  equally 
appropriate  when  the  sample  spaces  are  different.   The  two  designs 
should  be  compared  on  the  basis  of  an  equivalent  number  of  comparisons 
in  each.   Therefore,  a  "single  observation"  with  Design  I  will  be  taken 
as  n  =  R+C-2  comparisons  of  each  pair  in  the  design,  and  a  "single 
observation"  with  Design  II  will  be  taken  as  n   =  RC-1  comparisons  of 
each  pair  in  the  design.   This  gives  -RCiRC-l) {R+C-2)  total  comparisons 
in  each  design. 

Let  T. .  represent  the  treatment  with  the  first  factor  at  level  i 
and  the  second  factor  at  level  j .   The  Bradley-Terry  model  is  then 


^^^ij^\l)   =  "i/^^ij^\l^'     ''""^^ ""'         (l-^-l) 

j ,1=1, . . . ,C. 
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The  following  tests  of  hypotheses  were  considered  by  Littell  and 
Boyett. 

Test  1 :      H  :   TT .  .  =  1/RC  ,      H:   TT..=a.6.- 
o     13  a    13     1  ] 

This  is  a  test  for  detecting  two  main  effects  versus  no  treatment  dif- 
ferences.  Efficiencies  were  tabulated  for  the  2x2  case  (Littell  and 
Boyett  (1977) ,  Table  1) .   The  table  showed  that  Design  I  is  more  effi- 
cient than  Design  II  for  most  combinations  of  a  and  3- 

Test  2:      H  :  IT .  .    =    1/RC  ,      H  :   7T .  .  =  B  . /R  • 
01:  a     1:     : 

This  is  a  test  for  detecting  a  single  main  effect  versus  no  treatment 
differences.   For  this  test,  Design  I  was  shown  to  be  uniformly  more 
efficient  than  Design  II. 

Test  3:      H:   TT..=S./R,      H:   Tr..=a.3.. 
o     1:     3  a     1:     1  : 

This  is  a  test  for  detecting  two  main  effects  versus  a  single  main  ef- 
fect.  Efficiencies  were  again  tabulated  for  the  2x2  case.   The  table 
showed  that  Design  I  is  more  efficient  than  Design  II  for  most  combina- 
tions of  a  and  S- 

Test  4:      H:   7T..=a.3.,      H:   IT..^O. 
o     ij     1  j        a     ij 

This  is  a  test  for  detecting  interaction  versus  two  main  effects.   The 
results  showed  that  Design  II  is  uniformly  superior  to  Design  I  for 
detecting  interaction. 

Summarizing,  when  testing  for  main  effects  (Tests  1-3),  Design  I 
is  usually  more  efficient  than  II.   When  testing  for  interaction, 
Design  II  is  uniformly  more  efficient  than  I. 
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Littell  and  Boyett  suggested  that  it  might  be  a  good  idea  for  the 
experiment  to  be  conducted  in  two  stages.   The  first  stage  is  a  number 
of  replicates  of  Design  II  followed  by  a  test  for  interaction.   If  it 
is  significant,  the  second  stage  is  completed  by  again  using  Design  II, 
and  simple  effects  are  analyzed  by  applying  one-way  analyses  within  rows 
and  columns.   If  interaction  is  not  significant,  then  the  second  stage 
consists  of  replicates  of  pairs  in  Design  I  that  are  not  in  Design  II, 
and  main  effects  are  analyzed. 

The  total  n\mber  of  comparisons  to  be  made  in  the  experiment  can 
be  divided  into  the  two  parts  such  that  after  the  experiment  is  complet- 
ed, the  end  result  is  either  a  complete  Design  I  or  Design  II.   For 
example,  suppose  the  treatments  form  a  2^2  factorial,  and  resources  are 
available  for  24  comparisons.   In  the  first  stage,  the  experimenter  rims 
4  replicates  of  the  four  comparisons  in  Design  II  (see  Figure  1.1). 
If  interaction  is  significant,  two  more  replicates  of  the  four  compari- 
sons in  Design  I  that  are  not  in  Design  II  are  run.   The  latter  then 
results  in  the  same  comparisons  made  as  if  a  single  stage  experiment 

using  Design  I  had  been  conducted. 

n 
Ouenouille  and  John  (1971)  also  considered  designs  for  2   facto- 
rials in  paired  comparisons.   However,  they  assumed  an  individual  is 
asked  to  assign  a  number  on  a  scale  to  signify  the  degree  of  difference 
in  the  two  samples  instead  of  merely  deciding  which  sample  possesses 
more  of  the  parricular  attribute  under  study.   This  model  was  developed 
by  Scheffe  (1952) . 

In  particular,  Ouenouille  and  John  discussed  the  following  2 
factorial.   The  28  possible  paired  comparisons  were  divided  into  7  sets 
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of  4  blocks  as  follows : 


Set 

(1)  : 

(I, ABC) 

(A,BC) 

(B,AC) 

(C,AB) 

Set 

(2)  : 

(I,AB) 

(A,B) 

(C,ABC) 

(AC,BC) 

Set 

(3)  : 

(I, AC) 

(A,C) 

(B,ABC) 

(AB,BC) 

Set 

(4)  : 

(I,BC) 

(A, ABC) 

{B,C) 

{AB,AC) 

Set 

(5)  : 

(I, A) 

(B,AB) 

(C,AC) 

(BC,ABC) 

Set 

(6)  : 

(I,B) 

{A,AB) 

(C,BC) 

(AC, ABC) 

Set 

(7)  : 

(I,C) 

(A, AC) 

(B,BC) 

(AB,ABC) 

(1.4.2) 


The  letter  "I"  represents  the  treatment  where  all  factors  are  at  their 
low  levels.   If  a  letter  appears,  then  that  factor  is  at  its  high  level. 
Note  that  each  treatment  appears  once  in  each  set.   These  sets  are  con- 
structed by  first  pairing  treatment  I  with  each  of  the  remaining  treat- 
ments.  These  are  called  the  initial  blocks.   The  remaining  blocks  in 
the  sets  are  constructed  by  multiplying  the  initial  block  by  any  treat- 
ment that  has  not  yet  appeared  in  that  particular  set,  with  the  usual 

2     2     2 
rule  that  A   =  B   =  C   =1. 

To  illustrate  this  technique,  we  will  construct  set  (1)  in  (1.4.2). 
The  initial  block  is  (I, ABC).   So  far  only  I  and  ABC  have  appeared,  so 
we  may  choose  any  treatment  other  than  these.   Suppose  we  choose  BC. 
Then  the  next  block  in  the  set  would  be  (BC,A) .   Note  that  order  is 
unimportant.   Now  we  may  choose  any  treatment  other  than  I,  ABC,  BC,  or 
A.   If  we  choose  B,  we  get  the  third  block  in  set  (1) .   To  construct  the 
fourth  block,  there  are  only  two  choices  remaining,  namely  C  or  AB. 
Either  one  results  in  the  last  block  of  set  (1). 

Each  set  lacks  information  on  the  effects  that  have  an  even  number 
of  letters  in  common  with  the  initial  block.   For  example,  the  initial 


17 

block  for  set  (1)  is  (I, ABC),  so  this  set  provides  no  information  on 
the  effects  AB,  AC,  and  BC,  i.e.  on  all  first-order  interactions.   Sim- 
ilarly, the  initial  block  for  set  (5)  in  (1.4.2)  is  (I, A),  so  this  set 
provides  no  information  on  B ,  C,  and  BC. 

This  concept  of  no  information  on  B ,  C,  and  BC  from  data  in  set 
(5)  may  be  viewed  as  follows.   If  the  responses  from  comparisons  in  set 
(5)  are  modeled  as 

^I,A)     =  ^^^^-^V  -  (^^-^I^  =  ^^^I,A)  ' 

^B,AB)    =  (y+a+b+(ab)-fe^)  -  (y+b+e^)  =  a+ (ab) +£  ^^^^^  , 
^(CAC)    =  (y+a+c+(ac)+e^^)  -  (y+c+e^)  =  a+(ac)+£^^^^^^  , 

^ (v>r   anr-'i  =  (y+a+b+c+ (ab)  +  (ac)  +  (bc)  +  (abc) +e,^^)  - 
(BL,ABC;  ABC 

(y+b+c+(bc)+e   ) 
BC 

=  a+(ab)  +  (ac)  +  (abc)+e,„^  ,„^^  , 
(BCABC) 

where  all  of  the  e ' s  are  independent  and  have  expected  value  zero ,  then 
it  is  clear  that  b,  c,  and  (be) ,  corresponding  to  the  effects  B,  C,  and 
BC,  are  not  estimable  from  the  four  comparisons  in  set  (5) . 

Quenouille  and  John  define  efficiency  as  follows.   Suppose  the 
design  is  made  up  of  r  sets,  s  (s  ^  r)  of  which  give  information  on  some 
particular  effect.   Then  s/r  is  the  fraction  of  the  comparisons  made 
that  give  infoirmation  on  that  particular  effect.   On  the  other  hand, 
suppose  that  each  set  is  run  exactly  once,  i.e.  each  pair  of  treatments 

is  compared.   It  can  be  shown  that  there  are  a  total  of  (2^-1)  sets, 

_,n-l 

2    of  which  give  information  on  any  particular  effect.   In  this  case, 

2    /(2  -1)  is  the  fraction  of  the  comparisons  made  that  give 
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Table  1.1. 

2       3 

Efficiencies  of  balanced  2   and  2   factorial  paired  comparison  designs 


Number  of 

Efficiency 

of  interactions  of  order 

n 

Design 

blocks 

0 

1 

2 

2 

{2} 
{1} 

2 

4 

1.50 

0.75 

0.00 
1.50 

{3} 

4 

1.75 

0.00 

1.75 

{2} 

12 

1.17 

1.17 

0.00 

3 

(1} 

12 

0.58 

1.17 

1.75 

{3,2} 

16 

1.31 

0.88 

0.44 

{3,1} 

16 

0.88 

0.88 

1.75 

(2,1} 

24 

0.88 

1.17 

0.88 

Notation:   {j}:   A  design  constructed  by  combining  all  sets  with  initial 
block  I  and  a  j-f actor  combination. 

{j,k}:   A  design  constructed  by  combining  the  designs  {j}  and 

{k}. 

Source:   Quenouille  and  John  (1971,  Table  1). 


information  on  any  particular  effect.   The  efficiency  defined  by  Que- 
nouille and  John  is  the  ratio  of  these  two  fractions.   In  other  words, 
the  efficiency  is  defined  to  be 


E  = 


s/r 


2"-V(2''-l) 


2      3 

Table  1.1  gives  the  efficiencies  of  some  designs  in  the  2   and  2 

cases.   These  designs  are  balanced  in  the  sense  that  all  main  effects 
are  estimated  with  the  same  efficiency,  all  first  order  interactions 
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are  estimated  with  the  same  efficiency,  and  so  on.   The  table  indicates 
that  in  the  2   case,  Design  11)  is  efficient  for  estimating  the  inter- 
action effect.   This  result  is  the  same  as  the  result  Littell  and 
Boyett  obtained  using  Bahadur  efficiency. 

El-Helbawy  and  Bradley  (1978)  considered  treatment  contrasts  in 
paired  comparison  experiments.   The  theory  developed  is  completely  gen- 
eral ,  but  they  specifically  showed  how  optimal  designs  can  be  found  in 
the  case  of  a  2   factorial.   Their  optimality  criterion  is  the  maximi- 
zation of  the  chi-square  noncentrality  parameter  from  the  likelihood 
ratio  test,  which  thereby  maximizes  the  asymptotic  power  of  the  test. 

Let  a^=(a  ,a  ,a  ),  where  a.  represents  the  level  of  factor  i, 
i=l,2,3,  and  each  a.  is  0  or  1.   Then  the  treatment  parameters  are 
defined  by  El-Helbawy  and  Bradley  to  be 


1    2    3    12     13     23     123  ,^  ^  ^, 

7T=1TTr7TTl-  7T  7T  TT  ,  (1.4.3) 

^      ^   ^2   ^3   ^^2   ^^3   ^2^   ^^2S 


for  all  a_.   The  factorial  parameters  are  defined  by  taking  logarithms 
of  the  8  treatment  parameters  given  by  (1.4.3).   So  from  (1.4.3), 

Y   =   logiT 


=   ^  logTT^^   .   ^  ^  logTT^^^^ 


123 

+   logiT 

,         a  a  a 

.  T      -       .^  .        i  j  12  3 

1=1  i<]  -' 


-     E  ^a'^  -  E  S  ^a^a 


123 

+  Y        .  (1.4.4) 

a.      a  a  a 
J  12  3 


i=l  i<j 

The  last  two  expressions  in  (1.4.4)  define  the  factorial  parameters 
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,     1  2  3  12  13  23  123 

Y^    /   Y^    ,   Y^    ,    Y^    ,    »   Y^    ,    ,   Y,    -,    .   Y,   ^   ^    .      These  parameters   are 
^1        ^2        ^3        V2        ^iS        ^2^3        ^1^2^3 

siibject  to   the   usual   analysis   of  variance   constraints,    namely 


a.=0 


1 


111 

Y    Y    '''  =        V    Y    123  -        y    Y    123 

Z.      a^a^a^  /,      a^a^a3  /,      a^a^a^ 

a^-0  a2=0  a3=0 


0    ,  i<j,    i,j=l,2,3,  (1.4.5) 


The  null  hypothesis  of  no  two-factor  interaction  between  the  first 
two  factors  is  now  considered.   This  test  may  be  made  by  testing 

12 
The  constraints  then  require  that  Y    =0,  a, ,a^=0,l.   The  null  hypoth- 

^^2      1   - 
esis  is  therefore  equivalent  to 

12     12     12     12 
"o=   ^00   -  -^01   -  ^^10   ^  ~^1    =   °  ' 

12      12      1""      12       1"* 
since  by  (1.4.5),   Y„„   -  Y„,   -  Y,„^  +  Y,  ,   =  4Y__*'.   Let  B   denote  a 
UU     ui      iU     ii      UU        — n 

matrix  whose  rows  are  orthonormal  contrasts.   If  we  let  Y'  = 

'^000'^00l''010'^01l'^00'^10l'Yll0''^lll''  "^^^  ^^^  "^11  hypothesis  is 
also  equivalent  to 


H  :   B   .Y   =   0  , 
o   — n=l-'- 

where  B   ,  =  ^  (1,1,-1,-1,-1,-1,1,1). 
— n=l    8 
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Let 


a  if  comparing  T.  and  T.  give  no  information  (in  the 
sense  discussed  by  Quenouille  and  John)  on  the  two- 
factor  interaction  between  the  first  two  factors, 


b   otherwise. 


where  n. .  is  defined  in  Section  1.2,  and  N 


-11^.- 


Then  12a  +  15b  =  1,  since  16  of  the  28  distinct  pairs  give  information 
on  the  two-factor  interaction.   El-Helbawy  and  Bradley  then  proceeded 
to  show  that  b  should  be  taken  as  large  as  possible  in  order  to  maximize 
the  noncentrality  parameter.   This  gives  the  result  b=l/16,  a=0.   So 
the  optimal  design  is  to  compare  the  treatments  that  give  information 
on  the  two-factor  interaction  between  the  first  two  factors.   These 
pairs  of  treatments  would  be  the  sets  (3),  (4),  (5),  and  (6)  in  (1.4.2). 

This  result  is  the  same  as  Quenouille  and  John  would  obtain  if 
they  wanted  to  find  an  optimal  design  to  estimate  AB  interaction,  since 
using  these  4  sets  maximizes  the  efficiency  of  the  AB  interaction  using 
their  definition  of  efficiency.   It  is  also  analogous  to  the  result 
Littell  and  Boyett  obtained  because  the  treatments  compared  in  either 
case  differ  either  in  the  level  of  A,  or  the  level  of  B,  but  not  both. 

El-Helbawy  and  Bradley  noted  that  the  result  discussed  in  the  two 
preceding  paragraphs  still  holds  if  other  specified  factorial  effects 
are  assumed  to  be  null  (e.g.  three-factor  interaction).   VThile  the  sta- 
tistics for  the  two  tests  may  differ,  their  limit  distributions  are  the 
same  for  either  H   or  H  . 
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El-Helbawy  and  Bradley  also  considered  simultaneously  testing  for 
the  presence  of  AB,  AC,  and  ABC  interactions.   In  this  case  the  null 
hypothesis  is 


where 


2n=3 


1^ 


H 


^=3!  =   °  ' 


1  1-1-1-1-1  1  1 
1-1  1-1-1  1-1  1 
1-1-1     1-1     1     1-1 


By  the  same  method  they  concluded  that  the  optimal  design  is  to  make 
the  following  comparisons  (using  Quenouille  and  John's  notation): 
(I, A),  (B,AB) ,  (C,AC) ,  and  (BC,ABC).   Note  that  this  is  set  (5)  in 
(1.4.2).   Note  also  that  this  is  the  only  set  that  contains  information 
on  all  three  of  the  effects  AB,  AC,  and  ABC.   So  this  design  is  also 
optimal  using  Quenouille  and  John's  definition  of  efficiency. 

Beaver  (1977)  considered  the  analysis  of  factorial  paired  compari- 
son experiments  using  the  weighted  least  squares  approach  of  Grizzle, 
Starmer,  and  Koch  (1969) .   He  considered  a  loglinear  transformation  on 
the  TT.'s.   This  approach  produces  noniterative  estimates  of  the  tt.'s. 
Also,  the  usual  tests  for  a  factorial  experiment  are  easily  implemented. 
However,  Beaver  gave  no  consideration  to  experimental  design. 


1.5   Response  Surface  Designs 

Springall  (1973)  considered  response  surface  fitting  using  the 
Bradley-Terry  model  with  ties  allowed  as  generalized  by  Rao  and  Kupper 
(1967).   The  model  is  given  in  (1.2.5). 
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The  logarithm  of  the  treatment  parameters  are  defined  to  be  func- 
tions of  continuous,  independent  variables,  x^,X2,  ...  ,x^,  measurable 
without  error,  i.e. 

s 
k=l 

Note  that  some  of  the  variables  can  be  functions  of  other  variables. 

2 
For  example,  s=2  and  x  =x    results  in  the  parameterization 

InTT  =8x.+6x.^.   The  parameters  9,3  ,  ...  ,8   are  estimated  by 
i    1  li    2  li  -L        s 

the  maximum  likelihood  method.   Appendix  B  has  an  APL  program  and  a 

Fortran  program  which  produce  maximum  likelihood  estimates  of  g^,  —  , 

S  ,  but  which  assume  there  are  no  ties, 
s 

Springall  presented  the  following  definition,  theorem,  and  example. 

Definition  1.1.   Analogue  designs  are  defined  to  be  designs  in  which 
the  elements  of  the  paired  comparison  variance-covariance  matrix  are 
proportional  to  the  elements  of  any  classical  response  surface  variance- 
covariance  matrix  with  the  same  design  points  and  an  equal  number  of 
replicates  at  each  design  point. 

The  advantage  of  such  designs  is  that  they  enable  certain  desirable 

properties  found  in  classical  response  surface  designs  (e.g.  rotatabi- 

lity,  orthogonality) ,  which  are  dependent  on  the  relative  sizes  of  the 

elements  of  the  variance-covariance  matrix,  to  be  readily  produced. 

* 
For  example,  consider  the  classical  regression  model   y  =  S^  + 

6  X  +  B  X  .   Then  an  experiment  can  be  designed  in  such  a  way  that  the 

variance-covariance  matrix  of  the  least  squares  estimators  3q,  B^,  and 
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B^  possesses  an  optimal  form.   For  instance,  the  classical  design  with 
an  equal  number  of  replicates  at  each  of  the  four  levels  x=-2,-l,l,2 
can  be  shown  to  be  rotatable ,  and  so  the  analogue  paired  comparison 
designs  discussed  in  Example  1.1  below  have  the  same  property,  i.e. 
var  ( In  TT  )  =  var  ( In  tt   )  . 

X  -X 

2 
The  analagous  paired  comparison  model  is   InTT  =Sx  +  6x.   An 

X    1     2 

analogue  paired  comparison  design  has  a  corresponding  variance-covari- 
ance  matrix  of  the  maximum  likelihood  estimators  6  ,Q    ,    such  that  each 
element  is  a  constant  times  the  corresponding  element  of  the  least 
squares  variance-covariance  matrix.   For  the  particular  example  of  a 
quadratic  model  currently  under  discussion,  var(6  )  =  c-var(S  ), 
var(B  )  =  c-var(6^) ,  and  cov(B  ,6.)  =  c-cov(B  ,6  ),  for  some  c. 

Springall  described  a  method  which  uses  linear  programming  tech- 
niques that  produces  an  analogue  design  with  minimum  elements  of  the 
variance-covariance  matrix.   The  following  theorem  shows  how  one  can 
produce  an  analogue  design,  but  it  does  not  necessarily  have  minimum 
elements  of  the  variance-covariance  matrix. 

Theorem  1.1.   If  a  classical  response  surface  design  has  certain  prop- 
erties dependent  on  the  relative  sizes  of  the  elements  of  the  variance- 
covariance  matrix,  then  the  analogue  paired  comparison  design  will  have 
the  same  properties  if 


ID 


*i:  1 1  *^i' 


k<l 


2 
where  >1>.  ,  =  7T.tt./(tt.  +  it.)  , 

1]   1  :   1   : 
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2 
Example  1.1.   Consider  the  quadratic  model   In  IT  =  Q   x  +  ^   x    ,    with 

design  coordinates  x=-2,-l,l,2.   Assimie  9=1  and  S  =3_=0,  and  set  N=150. 

Springall  showed  that  an  analogue  design  is  given  by  n. .  =  150/6  =  25, 

i<j,  i,j=l,2,3,4. 

An  alternative  design  may  be  obtained  by  using  linear  programming. 

Let  S  denote  the  variance-covariance  matrix  of  the  maximum  likelihood 

estimates  6,  and  6  .   By  simultaneously  maximizing  the  elements  of  Z 

subject  to  the  constraint  N=150,  a  design  which  minimizes  the  elements 

of  Z  is  produced.   Springall  did  this  and  arrived  at  the  design 

{n  =0,  n   =71,  n  =9,  n  =0 ,  n  =70,  n-^^^oK  after  integerization  of 

the  n .  .  .     t 

The  asymptotic  distribution  of  the  maximum  likelihood  estimates 

of  9,6^,  ...  ,B  was  presented  by  Springall,  but  he  presented  few  de- 
1        s 

tails.   Therefore,  the  maximum  likelihood  estimates  of  the  parameters 
6w  ...  ,S   and  their  asymptotic  joint  distribution  are  developed  in 
Chapter  2.   The  tie  parameter,  9,  is  not  considered  in  the  remainder 
of  this  dissertation. 


CHAPTER  2 


ASYMPTOTIC  THEORY  OF  THE 
MAXIMUM  LIKELIHOOD  ESTIMATORS 


2 . 1   Introduction 

This  chapter  contains  the  asymptotic  theory  for  the  maximum  like- 
lihood estimates  of  the  parameters  given  by  (1.5.1),  where  the  logarithms 
of  the  treatment  parameters  are  expressed  as  a  polynomial  function  of  a 
single  quantitative  variable,  x.   An  example  of  an  experiment  which  had 
a  single  quantitative  variable  was  given  in  Section  1.1.   The  treatments 
in  that  example  were  different  levels  of  an  additive  for  coffee.   For 
an  experiment  with  quantitative  independent  variables ,  it  is  appropriate 
to  do  a  paired  comparison  analogue  to  classical  regression  analysis. 

The  theory  developed  in  Sections  2.2  and  2.3  assume  the  general 
case  of  s  independent  variables  x  ,  ...  ,x  .   The  parameterization  of 
the  Bradley-Terry  parameters,  given  in  (1.5.1),  is  reproduced  here: 


TT.     =     V  3^X^.   , 

1       /_,   k  ki 


In  TT.    =    y      3,_x,  ,  ,     i=l,  .  .  .  ,t. 
k=l 

The  Bradlev-Terrv  model  with  ties  not  allowed  is  used,  where  the  tt.  are 

1 

defined  by  (1.2.2) . 

In  order  for  all  of  the  parameters  8  ,  ...  ,S   to  be  estimable,  it 
is  required  that  s  <.   (t-1)  .   This  is  clearly  necessary  since  the  Bradley- 
Terry  parameters  have  dimension  (t-1) .   Note  also  that  an  intercept 
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parameter,  6  /  is  not  estimable  without  imposing  a  constraint  on  the 
Bradley-Terry  parameters.   This  becomes  apparent  when  examining  the 
preference  probabilities.   For  example,  suppose  the  model  was 

s 

1"^  =  ^  ■"  E  Vki '    '^' ^• 

k=l 


Then 


P(T.   ->  T.)      =     •iT./('n" .    +  ■'T  .) 
ID  1        1  : 


s 
exp(S 


0 

k=l 


O 

Y  '^\i' 


^^p^^  ^  S  ^Ai^ "  '"^^^0 "  E  ^ 


k=l  k=l 

s 

^^p^  E  Vki> 

k=l  iT^j 


S  S  •        •      T  <. 

1,3=1, . . . ,t. 


^^P(   E    Vki^    +  exp(  ^    8^x^.: 
k=l  k=l 


The  parameter  S   falls  out,  implying  that  any  choice  of  S   results  with 
the  same  preference  probabilities.   Choosing  3  =0  replaces  the  imposi- 
tion of  a  constraint  on  the  treatment  parameters. 


2.2   Estimation 


As  was  previously  mentioned,  the  parameters  3,,  .-•  /6  are  esti- 
mated by  the  maximum  likelihood  method.  From  (1.3.1),  the  log-likeli- 
hood equation  is 
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In 


L  =   ^  a.lnTT.  -  )       }     n.  .ln(Tr.  +  tt.; 


i=l 


i<j 


=  E^S 


i=l 


\\i 


Lk=l 


(2.2.1) 


i<j 


^k\j^ 


k=l 


k=l 


The  maximum  likelihood  estimators  are  found  by  taking  partial 
derivatives  of  the  log-likelihood  equation,  setting  them  equal  to  zero, 
and  solving  for  the  parameters.   The  likelihood  equations  are 


3ln  L 


Z^    ^i^ri    zL  Zj  "^i: 


c  .exp()>   6,  X   )  +  X  .exp(^   8,  x,  .) 
ri    /_,   k  kx     rj  /_,      k  k^ 


k=I 


k=l 


i=l 


1^3 


^^P^Z  Vki^  +  exp(^  S^x^.) 
k=l  k=l 


Z_.  Zj  "'ij^ri    Zj  Zj  "^i: 


X  . exp ( 

ri 


S  Vki^  ^  ^j^^p^Z  Vkr 


k=l 


i?^j 


i?^j 


'E  Vki^  -exp(^  S^x^.: 


"^p^Z.  Vki^  ^  ^^p^ 

k=l  k=l 


Z_J  Z_»    ID    ]   TT.  +  T. 


£1   - 


=   0  ,    r=l, . . . ,s. 


(2.2.2) 


if^j 


1     D 


where  m. .  is  the  total  number  of  times  T.  is  preferred  over  T. 
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These  equations  must  be  solved  iteratively.   Appendix  B  contains 
an  APL  program  and  a  Fortran  program  which  find  the  estimates  of  Q    , . . . , 

6  .   The  procedure  described  in  the  appendix  converged  for  most  situa- 

s 

tions.   However,  occasionally  when  an  attempt  was  made  to  fit  a  full 

model  (s=t-l) ,  the  procedure  did  not  converge,  which  remains  unexplained. 

In  this  situation  one  can  resort  to  the  program  found  in  Appendix  A 

which  finds  estimates  of  the  Bradley-Terry  parameters,  and  then  solve 

(t-1)  equations  in  (t-1)  unknowns  to  find  the  estimates  of  6,,  ...  ,S  • 

Is 

2.3  Asymptotic  Distribution 

First  of  all,  some  additional  notation  and  elementary  theory  is 
presented.   This  will  become  useful  when  the  asymptotic  joint  distribu- 
tion of  3, ,  ...  ,6  is  derived. 
1        s 

Let  X. .,  be  a  random  variable  which  is  equal  to  1  if  T,  is  selected 

ijk  1 

over  T.  for  the  k    comparison  of  T.  and  T.,  0  otherwise.   Then  X. ., 
has  the  Bernoulli  distribution  with  probability  of  "success"  equal  to 
TT./(''T.  +  IT . )  ,  i,j=l,  ...  ,t,  k=l,  ...  ,n..,  and  the  Bernoulli  random 
variables  are  independent  of  each  other.   This  implies  that  m. .  has  the 
binomial  distribution,  with  sample  size  n. .  and  "success"  probability 
equal  to  tt  .  /  CfT .  +  ^  .)  ,    where 

n .  . 
ID 


1.  .    =    >   X.  .,   , 
ID        </j   iDk 


i<j,  i,j=l,...,t. 
k=l 

Furthermore,  the  m. ,'s  are  also  independent  of  each  other,  and  from  the 
properties  of  the  binomial  distribution  we  have 


Em..    =   n.  .TT./Cn-.  +  tt  . )  ,     i<j,  i,j=l,...,t,         (2.3.1) 
ID        1]  1    1     : 
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var(m.  .)   =  n.  .it  .tt  ./ (tt  .  +  it  . )   ,   i<j  ,  i,j=l,...,t,    (2.3.2) 


cov(in.  .  ,m,  , )   =   0  , 

13   kl 


i<j,  k<l,  (iT^k  or  JT^l), 
i,j,k,l=l,...,t. 


(2.3.3) 


From  (2.3.1),  (2.3.2),  and  (2.3.3),  it  follows  that 


E(in.  .itL  .,  )   =   (Em.  . )  (Em,  ,  ) 


\j\l 


n.  .IT.    n  'IT 
ij  1    kl  k 


ij    kl 


IT.  +  TT  .  TT,   +  TT, 
1     D   k     1 


(2.3.4) 


and 


2  2 

Em. .    =  var(m. .)  +  (Em. .) 
13  1:        ID 


2   2 

n..7T.TT.  +  n..  TT 
(TT.  +  TT.) 

1   : 


(2.3.5) 


Under  certain  regularity  conditions  verified  by  Springall  (1973) , 

it  follows  from  a  theorem  found  in  Wilks  (1962,  page  380)  that 

vN(3  -6, ) ,  ...  ,  /n(B  -6  )   is  asymptotically  multivariate  normal, 
11  s   s 

with  mean  vector  0  and  variance-covariance  matrix  (A  ,  )   ,  where 
—  ab 


^  K   =   E 
ab 


31n  L   3ln  L 


36     36, 


a,b=l,...,s.      (2.3.6) 


We  now  proceed  to  derive  the  as\Tnptotic  variance-covariance  matrix 

by  deriving  A    for  general  a  and  b.   From  (2.2.2)  we  have 
ab 


3ln  L     V""  'x"'   ai   aj    ^        ^      V^  V^  "  ai   aj 

—Ka —  -        y        /      ^m..TT.   +    )   /   =^m..TT. 


i<3 


1    D 


3--1 


1    3 
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11 

i<j 


'11 

i<j 


X    .  -X    . 

ai      a] 


m.  .TT  .    + 


X      .-X      . 

aj      ai 


(n  ,  .-m.  .  )7T . 


IT.     +    7T  .        11     1  TT  .     +    TT  .  11        11        1 

LID  1        : 


X      .  -X      . 

ai      aj 


m.  .  (x    .  -X    . )    -  n  .  .71 . 

11      ai      ai  11    1  IT .+  IT  . 

1  j 


,    a=l,...,s.     (2.3.7) 


Then    from    (2.3.4)-(2.3.7),    we    find   X   ^    to  be 

ab 


X    ,        =      E 
ab 


1111 

i<j  k<l 


X    .  -X    . 
,  ai      ai 

m..(x    .-X    .)    -n..7T.    ^ 

11      ai     ai  ij    1  ir .    +  IT . 

ID 


bk    iDl 


\] 


\i'^bk-\i'  -  \i\^r-Tif 


k  1 


Zj      Zj     Z_.     Z_J       (TT  .     +    TT  .  )   {71        +    TT 

— -^^  T  ^-1  1  1        k  1 


-   (x    .-X    .) (x      -X      ) 
)         ai      ai        bk     bl 


i<j  k<l 

{ifik  or   JT^l) 


2      2 

n..TT.TT.     +    n..    TT. 


r — I    r^ — I    n  .  .  (I  .  II  .    -t-   n  .  .    n  . 

11  '\:\.:i ' 


i<j 


(TT.      +    TT  .  , 

1        : 


(X      .-X      .)    (X,   ,   -X         ) 

ai      aj        ok     bl 


bk      bl 


^     /_j     Z_j     ^     TT  +    TT  .        TT,      +  TT  ai        ai 
i<j                 k<l              ^              ^           ^              ^ 

^  Y  Y  Y  Y  "ii^^l^i^i^  (X   -X   )  (    -X   ) 

/  ■  /  ■  /  ■  Z_)  (TT .  +  TT  . )  (TT   +  TT  )  ai  '  aj    ak     bl 


i<j     k<l 


'11'. 


TT.  TT  . 


(TT  .  +  TT  .  ) 
X<J  1      J 


(x  .-X  .)(x^.-x^.),  a,b=l,...,s.     (2.3.8) 
ai   ai    bl   bj 
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As  previously  mentioned,  the  remaining  chapters  deal  with  finding 
optimal  designs  when  the  logarithm  of  the  treatment  parameters  is  ex- 
pressed as  a  polynomial  equation  in  a  single  variable.   The  various 
optimality  criteria  considered  include 

(i)   Minimization  of  the  variance  of  the  maximum  likelihood  esti- 
mator of  one  parameter, 
(ii)   D-optimality, 
(iii)   Minimization  of  the  average  variance  of  the  predicted 
"response".  In  tt  , 
(iv)   Minimization  of  the  maximum  variance  of  In  tt   (minimax)  , 

X 

(v)   Minimization  of  the  bias, 
(vi)   Minimization  of  the  average  mean  square  error  of  In  t  when 
bias  is  present  (J-criterion) , 
(vii)   D-optimality  for  a  preliminary  test  estimator. 

These  are  all  defined  in  subsequent  chapters. 

For  the  case  of  a  single  quantitative  independent  variable,  the 
model  given  in  (1.5.1)  becomes 


'i  -  X  ^^i'   ■ 


In  7T,   =   P"   S,.x,    ,  i=l,...,t.  (2.3.9) 

k=l 

Similarly,  the  variance-covariance  matrix  given  in  (2.3.8)  becomes 

(A  ,  )   ,  where 
ab 


V  V         ''i^'j      a   a    b 
=   )        /   n.  .  -^ — -   (x.  -X.  )  (x.  -X 


X  ^   =   >   >   n.  .  "  ^  .,  (x."-x.")  (x."-x.^)  ,  a,b=l,...,s. 

^"^  "■  3  (2.3.10) 
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Notice  that  the  complete  design  problem  is  quite  complex.   It 
involves  deciding  how  many  levels  and  additionally  which  particular 
levels  should  be  chosen.   Furthermore,  it  must  be  determined  how  often 
to  compare  each  pair  of  treatments. 

A  further  complication  is  apparent  by  noticing  that  the  variance- 
covariance  matrix,  whose  elements  are  given  in  (2.3.10),  depends  on  the 
true  parameter  values.   Hence  the  optimal  designs  also  depend  on  the 
parameters.   The  designs  discussed  by  El-Helbawy  and  Bradley  and  Spring- 
all  were  found  under  the  ass\jmption  that  all  Bradley-Terry  treatment 

parameters  are  equal,  or  equivalently  that  6  =6  =  •••  =6  =0.   In  no 

12        s 

paper  of  which  the  author  is  aware  was  the  dependency  of  the  optimal 
design  on  the  true  parameter  values  examined.   As  will  become  apparent 
in  the  following  chapters,  the  optimal  design  for  one  set  of  parameter 
values  can  be  quite  different  from  the  optimal  design  for  another  set 
of  parameter  values . 


CHAPTER  3 


MINIMIZATION  OF  THE  VARIANCE 
OF  A  SINGLE  PARAMETER  ESTIMATE 


3 . 1   Introduction 

The  present  chapter  contains  a  discussion  of  the  linear,  quadra- 
tic, and  cubic  models.   The  optimality  criterion  considered  is  the 
minimization  of  var(S.),  where  i=l,2,  and  3  for  the  linear,  quadratic, 
and  cubic  models,  respectively.   The  linear  model  is  discussed  in  Sec- 
tion 3.2.   Designs  for  the  quadratic  model  are  found  in  Section  3.3  for 
S_=0,  3,  variable.   The  general  expression  for  var(Bp) ,  given  by 
(3.2.5),  can  be  shown  to  be  a  continuous  function  of  S    ,    and  hence  the 
designs  in  Section  3.3  are  locally  optimal  at  the  point  6_=0.   Likewise, 


de 


signs  for  the  cubic  model  are  found  in  Section  3.4  for  S  =0,  8   and 


S_  variable,  and  are  similarly  locally  optimal. 


3 . 2   Linear  Model 


From  (2.3.9),  the  linear  model  is 


In  TT.   =  Sx.  ,  i=l,...  ,t.         (3.2.1) 

1       1 

Since  there  is  only  one  parameter,  by  (2.3.10)  the  variance-covariance 
matrix  becomes  a  simple  variance,  X      ,  where 

6(x.  +  X.) 

\  =  y  y  n..  -^ — ^ —  (X.  -  x.)^ 

i<j       (e    +  e  ■') 
34 
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-11'. 


(X.  -  x.)^ 

1    1 


.     .  (exp(S(x.-x.)/2)  +  exp(6(x.-x.)/2)) 


^   2 

X   Z  ""ij    6d  /2  ^'  -6d 
i<j       (  e   -^    +  e    -' 


7^ ,  (3.2.2) 


where  d.  .=x.-x..   For  the  remainder  of  this  dissertation,  it  is  assumed 
without  loss  of  generality  that  the  independent  variable,  x,  is  scaled 
such  that  it  is  in  the  interval  l-1>i]. 

Although  it  is  not  necessary  to  treat  the  two  cases  6=0  and  87^0 
separately,  the  special  case  8=0  is  considered  first  because  the  arg^a- 
ment  used  to  derive  the  optimal  designs  is  easier  to  follow  for  this 
situation.   When  6=0,  (3.2.2)  reduces  to 


^      =       /      /      n..(x.  -  x.)^/4      .  (3.2.3) 

i<j 


The  expression  in  (3.2.3)  is  a  maximum  when  all  the  "weight"  of  the  n. . 

2 
is  placed  onto  pairs  which  maximize  (x.  -  x.)  .   Clearly  this  implies 

that  the  design  which  minimizes  var(6)  is  a  comparison  of  only  the  pair 

(-1,1). 

The  designs  which  maximize  X  when  87^0  are  found  using  an  argument 

identical  to  the  one  used  for  the  case  3=0.   From  (3.2.2),  all  of  the 

"weight"  of  the  n. .  should  be  placed  onto  pairs  which  maximize 
ID 

2      3d/2     -6d/2  2  ..  _  .. 

y  =  d  (e     +  e     )   ,  (3.2.4) 

where  d  is  then  the  optimal  difference  between  the  levels  in  the  pairs. 
The  value  of  d  which  maximizes  y  in  (3.2.4)  is  the  solution  to 
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:^r                             OA  a^2^  6d/2     -6d/2^ 

h.     =  2d _   Bdje ^_e I  n  2  5) 

3d      ,  6d/2     -6d/2  2  ,  6d/2     -6d/2, 3         '    (^•^■^) 

(e     +  e     ;  (e     +  e     ) 


The  equality  in  (3.2.5)  implies 

coth(6d/2)   =  3d/2   .  (3.2.6) 

The  solution  to  coth (u)  =  u  is  a  transcendental  number,  and  can  be 
shown  to  be  approximately  u=1.1997.   Hence,  from  (3.2.6)  and  the  fact 
that  |d|  must  be  less  than  or  equal  to  2,  the  design  which  minimizes 
var(B)  for  a  given  value  of  8  is 

Idl   =   Ix.  -  x.l   =   min(2,2.3994/l si )   .  (3.2.7) 

2.  J 

It  is  now  shown  that  the  value  of  |d|  given  in  (3.2.7)  is  in  fact 
a  maximum  for  y,  and  consequently  for  A.   By  (3.2.5),  the  second  par- 
tial derivative  of  y  with  respect  to  d  is  given  by 

3^y  .  6d/2  ^   -Bd/2.2 
— -   (e     +  e     )    = 

dd" 

2   -  4d6-tanh(Bd/2)  -  S^d^/2  +  |i3^d^tanh^  (Sd/2)   .    (3.2.8) 

2     2 

The  second  partial  derivative   9  y/9d   is  negative  if  and  only  if  the 

expression  in  (3.2.8)  is  negative.   From  (3.2.6),  the  equality 

2   =  8d-tanh(Bd/2)  (3.2.9) 

holds  at  d=2. 3994/1 Sl ,  which  is  then  substituted  into  (3.2.8)  to  give 


9d^ 


8  -  Q^d^/2   +  6  =  -Q^d^/2      <      0   .       (3.2.10) 


opt.  d 
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Because  there  is  only  one  solution  to  (3.2.6)  where  d>0,  the  result  in 
(3.2.10)  implies  that  the  solution  of  |d[  given  in  (3.2.7)  does  in  fact 
minimize  the  variance  of  6. 

By  (3.2.7)  the  optimal  design  is  a  comparison  of  only  the  pair 
(-1,1)  when  S  <1.2.   It  can  be  shown  that  P(l  h-  -1)=.92  when  6=1.2. 
Because  of  this  relatively  large  preference  probability  of  choosing  one 
endpoint  over  the  other,  in  most  practical  situations  3  will  be  less 
than  1.2.   So  in  these  cases  the  optimal  design  is  a  comparison  of  only 
the  endpoints  of  the  experimental  region. 

The  optimal  designs  given  by  (3.2.7)  are  also  optimal  for  other 
criteria.   In  particular,  they  are  optimal  for  criteria  (ii)-(iv)  intro- 
duced in  Section  2.3.   These  criteria  are  formally  defined  in  Chapter  4, 
but  a  brief  explanation  for  their  equivalence  in  the  case  of  a  linear 
model  follows.   The  equivalence  of  the  criterion  being  discussed  in  the 
present  section  to  D-optimality  follows  from  the  fact  that  the  deter- 
minant of  a  1x1  matrix  is  simply  the  only  element  in  the  matrix.   The 
equivalence  to  the  other  two  criteria  follows  from  the  fact  that 

2    ^ 
vardn  tt^)   =  x  var(6)   .  (3.2.11) 

From  (3.2.11),  criterion  (iii)  is,  in  this  case,  the  minimization  of 

/     2  2  '^ 

I    X  var(B)  dx  =  -  var(6)   , 

-1 

and  criterion  (iv)  is  the  minimization  of 

2    ^ 
max   X  var(B)   =  var(6) 

xeL-1,1] 
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3 . 3   Quadratic  Model 
The  quadratic  model  is 

In  TT.      =      6^x.  +  Q^x^      ,  i=l,...,t.         (3.3.1) 

From  (2.3.10),  the  asymptotic  variance-covariance  matrix  of  the  maxi- 

mum  likelihood  estimators  S,  and  3   is  (A  ,  )   ,  where 

1      2      ab 


X^^   =   >   >  n,^<|)^^(x,  -  X  J    ,  (3.3.2) 


)       )  n.  .<j).  .  (x.  -  X.)    , 
i<j 

A--   =   >   >  n..cj)..(x.  -  X.)  (x.^  -  x.^)   ,  (3.3.3) 

12      Z_i  ^   ID  ID   1     D    1      D 

i<j 

y       }  n.  .({)..  (x.   -  x .' 
Z_i  <£_!   ID  ID   1      D 


^22   =   2   }      n_(J)_(x/  -  x^^)^   ,  (3.3.4) 

i<j 

and  where 

exp(  S, (x.  +  X.)  +  S^(x.~  +  x.~)  ) 


2 


(x.,x.)   = 


1   i     J 2   i      j 


^■'        ^      ^  (  exp(S,x.  +  S_x.  )  +  exp(6,x.  +  B-X.")  )^ 

li     2i  I3     23 


i<j,  i,j=l,...,t,  (3.3.5) 


Minimization  of  var(B^) 


Consider  the  test  of  the  hypothesis 


H  :   6„  =  0  ,   8-  unspecified, 
o     2         1 


H  :   S_  5^  0  ,   S   unspecified. 
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Minimizing  the  asymptotic  variance  of  6_  would  equivalently  be  maximiz- 
ing the  asymptotic  power  of  the  test.   The  variance  of  6   is  the  lower 

right-hand  element  of  the  2^2  matrix  (X  ,  )   .   That  is, 

ab 

'^11 
varCB^)   =  J  .  (3.3.6) 

^11^22  "  '^2 
Under  the  null  hypothesis,  (3.3.5)  becomes 


B^(x^  +  X.) 
(  e     +  e   -'  ) 


As  was  pointed  out  in  Section  3.1,  in  the  present  section  (3.3.6) 
is  minimized  for  B  =0.   This  produces  locally  optimal  designs.   Assioming 
6  =0  greatly  simplifies  the  design  problem  as  will  be  seen  in  the 
remainder  of  the  section. 

The  end  result  of  Lemmas  3.1-3.2  and  Theorems  3.1-3.3  is  a  set  of 
optimal  designs  which  minimize  var(6  )  under  the  null  hypothesis  for 
various  choices  of  the  linear  parameter.   Hereafter,  "optimal  design" 
will  refer  to  the  design  which  is  optimal  for  the  criterion  being  dis- 
cussed in  the  section. 

The  following  two  definitions  are  useful  in  the  discussion  that 
follows . 

Definition  3.1.   The  pair  of  treatments  (-x  ,-x  )  is  defined  to  be 
the  symmetric  counterpart  of  the  pair  (x  ,x  ) . 

Definition  3.2.   A  design  is  said  to  be  symmetric  if  each  pair  in  the 
design  is  compared  as  often  as  its  respective  symmetric  counterpart. 
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Lemma  3,1.   Let  (l)(x.,x.)  denote  4 .  .  as  given  by  (3.3.7).   Then 

(x.,x.)    =   (t  (-X.  ,-x . )  ,    for  any  x.    and  x.. 

1      :  1        :  ID 


Proof. 


•^(x.  ,x.) 


6t (x.    +  x.)  -26, (X.    +  X.) 

1      1  ]  111 

e  -■  e  ■' 


i'    j  8,x.  3,x.      „        -26, (X.    +  X.) 

,li  li2  li  -1 

(   e  +  e        -'    )         e  ■' 


B,  (-X.-X.; 
e    ^        ^      ^ 


6,(-x.)  S,{-x.)      _ 

(    e  -'      +   e  ) 


=      (})(-x.  ,-x .)     .  t 

1         3 

Theorem  3.1.   The  optimal  design  is  a  symmetric  design. 
Proof.   Notice  that  both  of  the  following  hold: 

(i)     (X.  -  x.)^   =   (  (-X.)  -  (-X.)  )^  , 

:   1         3     1 

(ii)    (x.^  -  x.^)   =   (  (-x.)^  -  (-X.)"  )  . 
3     1  3        1 

From  (3.3.2),  (3.3.4),  Lemma  3.1,  and  the  above,  it  is  clear  that  X 

and  A   are  invariant  under  changes  of  any  number  of  comparisons  of 

pairs  to  comparisons  of  their  symmetric  counterparts. 

Let  D  denote  any  particular  design,  and  let  var   (6_)  be  the  var- 
1  1 

iance  of  B   for  Design  D  .   Also,  let  the  i   pair  in  D  be  denoted 

(x.,xl).   The  sets  of  comparisons  {(x.,xl),  (-x.,-xl)}  are  considered 
11  1111 

in  sequence,  and  without  loss  of  generality,  it  is  assumed  that 


n     ,  -  n      ,   =  d.   ^  0  , 
X.  ,x  I     -x . ,-x .       1 

11      11 


for  all  1.   Notice  that  it  could  be  true  that  n      ,  =  0. 

-x. ,-x: 

1   1 
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Design  D  is  formed  from  Design  D  by  changing  d./2  of  the  compar- 
isons of  the  pair  {x.,xl)  to  comparisons  of  the  pair  (-x  ,-x').   This 
11  11 

results  in   (n    ,  +  n      ,)/2   comparisons  of  each  of  the  two  pairs 
X. ,xl    -X. ,-x: 

11      11 

in  the  i   set.   This  change  is  made  for  each  set  of  comparisons,  there- 
by defining  Design  D  to  be  a  symmetric  design.   The  total  number  of 
comparisons,  N,  is  left  unchanged. 

By  the  first  paragraph  of  this  proof,  the  values  of  ,\   and  A 

are  the  same  for  the  two  designs.   By  (3.3.3),  'V   =0  for  Design  D  , 

2 
and  hence  X    is  a  minimum.   Therefore,  by  (3.3.5), 


var   (3  )   2.  var   (6„)   .  (3.3.8) 

2  "l   ^ 


Note  that  the  variances  are  equal  if  A   =0  for  Design  D  ,  and  it 

12  ^1 

is  possible  that  -^,^=0  for  a  nonsymmetric  design.   However,  (3.3.8) 

shows  that  no  design  can  "do  better"  than  a  symmetric  design.   Also 

note  that  in  practice,  d.  must  be  an  even  integer  in  order  for  the 
n  .  .  ' s  to  be  integers . 

So  the  search  for  optimal  designs  in  the  present  section  will  hence- 
forth be  restricted  to  the  class  of  all  symmetric  designs. 

Because  ^.2~^   ^°^  ^  symmetric  design,  (3.3.5)  reduces  to 

var(62)   =   I/A22  •  (3.3.9) 

So  it  is  now  necessary  to  find  designs  which  maximize  A.   .   Notice  that 
^22  depends  on  3  .   As  previously  mentioned,  the  optimal  design  also 
depends  on  the  value  of  8  . 
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Theorem  3.2.   The  optimal  design  is  a  design  in  which  the  only  compar- 
isons made  are  comparisons  of  the  pairs  (x,l)  and  (-1,-x)  an  equal  niim- 
ber  of  times,  for  some  x.   Furthermore,  x^  0. 

Proof.   First  of  all,  the  notation  used  for  X   ,  v^ich  is  defined  by 
(3.3.4)  and  (3.3.7),  is  changed.   The  N  total  comparisons  are  arbitrar- 
ily ordered,  and  the  i   pair  is  then  defined  to  be  (x. ,xl).   The  vari- 

11 

ables  y.  and  z.  are  defined  to  be 


z .    =   x.    +   xl     ,  i=l, . . . ,N. 

Ill 


Then   from    (3.3.7) , 


8,  (x.    +  x!)  -6,  (X.    +  x!) 

Ill  111 

e  e 


B,x.  S,x:       _        -6, (x.    +  x!) 

,        li^        li\2  li  1 

(    e  +  e  )         e 


S,y,/2         -6^y./2 
(    e  +   e  ) 


i=l, . . . ,N, 


Notice  that  6.    is  a  function  of  y.  but  not  of  z . .   From  (3.3.4),  A^-  is 
1  11  22 


rewritten  as 


*22 


V  ^    2   2 

)     <i>.y.    z. 
/  .   11  1 


1=1 


Let  D  be  any  design.   By  holding  y.  fixed,  we  examine  what  changes 

in  z.   will  increase  \^^.      Clearly  if   z.l  is  as  large  as  possible  for 

1  22  ^     '  i' 

every  i,  then  \^   is  also  as  large  as  possible  for  the  particular  set 
^  2 

of  y.'s  found  in  D.   Without  loss  of  generality,  it  is  assxamed  that 

x.<xl.   Then  if  either  x.=-l  or  x!=l,  I z.l  is  maximized.   Therefore, 
11  1        11 
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all  comparisons  must  involve  either  x=-l  or  x=l.   Additionally,  using 
an  argument  similar  to  one  used  in  Section  3.2,  it  is  clear  from  the 
expression  for  A   given  in  (3.3.4)  that  x=l  should  be  compared  with 

one  and  only  one  level  of  x,  namely  the  value  of  x  which  maximizes 

2  2 
(}'(l,x)  •  (1-x  )  .   This  result  in  conjunction  with  Theorem  3.1  proves  the 

first  part  of  the  theorem. 

We  can  now  rewrite  \        simply  as 

A22   =   N(}){l,x)  .  d-x")^  . 

It  remains  to  be  proven  that  the  optimal  value  of  x  is  such  that  x  ^0. 

The  variable  H^  (x)    is  defined  to  be  the  positive  square  root  of 
A^/N,  i.e. 

6^(1  +  x)/2 

'P(x)   =  ^-g ^-^  (1  -  X  )  .  (3.3.10) 

e   +  e 


Since  (3.3.10)  and  the  fact  that  x£[-l,l]  imply  'Kx)  ^0,  maximizing 
A   is  equivalent  to  maximizing  ij^(x). 

It  will  now  be  shown  that  'Mx)  ^'|i(-x)  ,  x  ^  0.   The  following  five 
inequalities  are  equivalent: 

^{x)       ^     ^(-x)  (3.3.11) 


5^(1  +  x)/2        S^d  -  x)/2 

(3.3.12) 


^1       ^r-  h       -\ 

e   +  e  e   +  e 


|6^(l+x)+6^    |6^(l+x)-3^x       i^^(i-x)+3^    |6^(l-x)+3^x 


^  e  +  e  (3.3.13) 
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3^(1  +  x)/2     -6^(1  +  x)/2      B^d  -  x)/2     -6  (1  -  x)/2 
e  +  e  ^  e  +  e  (3.3.14) 


cosh(u  +  6  x)  ^  cosh(u)  ,  (3.3.15) 

where 

cosh(u)  =  (e  +  e   )/2  , 

u  =  e^(l  -  x)/2  . 

Now  cosh(u)  is  a  monotonically  increasing  function  of  u  for  u.  ^  0. 
Furthermore,  it  can  be  assumed  that  B  ^0  because  Theorem  3.3  proves 
that  the  optimal  designs  for  8  =  -S    are  the  same.   Or,  equivalently , 
the  remainder  of  this  proof  can  be  repeated  for  the  case  B  <0.   Then 
X  ^  0   and   B   ^0   implies  Q   x    ^0,  and  hence  by  the  equivalence  of 
(3.3.11)  and  (3.3.15),  '4^  (x)  ^'4'(-x)   for  all  x  ^  0.   This  completes 
the  proof  of  the  second  part.     t 


The  next  theorem  shows  that  optimal  designs  only  need  to  be  found 
for  nonnegative  values  of  S, • 

Theorem  3.3.   The  optimal  design  for  B  =-B    is  the  same  as  the 
optimal  design  for  S  =6   . 

Proof.   Recall  that  the  optimal  design  is  found  by  finding  the  value  of 
X  which  maximizes  'l^(x)  from  the  proof  of  Theorem  3.2.   Since  '4)  (x)    is 
actually  a  function  of  3  and  x,  we  '/rrite 

B^d  +  x)/2 

'^<2wx)   =  ^-^ -— -  (1  -  x^)  . 

e   +  e 
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The  theorem  is  proved  by  observing  that 


6^(1  +  x)/2  -6^(1  +  X 

'l'(3wX)   =  ^ ^-—  (1  -  x^^    ^ 


1'  '       S^    B^x   ^^   "  '     -6^(1  +  X) 
e   +  e  e 


-e,    (1  +  x)/2 

2 
(1  -  X  ) 


-6,x    -B^ 
e     +  e 


ijj(-6^,x) 


All  that  remains  to  be  done  is  to  find  the  value  of  x  that  maxi- 
mizes i|j(x)  for  various  choices  of  B   ^  0.   Unfortunately,  a  closed  form 
solution  of  X  as  a  function  of  3   does  not  exist.   However  when  3-=0, 
the  optimal  value  of  x  can  be  analytically  derived,  and  hence  this 

situation  is  considered  first. 

2 
Suppose  3  =0.   Then  from  (3.3.10),  i|;(x)  =  (1  -  x  )/2.   Clearly 

this  is  maximized  by  x=0,  and  hence  from  Theorems  3.1  and  3.2,  the 

optimal  design  is  an  equal  number  of  comparisons  of  only  the  pairs 

(0,1)  and  (-1,0).   For  the  case  3  t^O,  the  grid  method  described  in  the 

next  paragraph  was  used  to  obtain  the  results  presented  in  Table  3.1 

and  Figure  3.1. 

The  grid  method  utilized  first  calculated  "Mx)  for  x=0(.l)l, 

and  the  best  value  of  x,  say  x  ,  out  of  these  11  choices  was  found. 

Then  ijj(x)  was  calculated  for  the  11  values  x=  (x  -.  1)  ,  (x  -.08)  ,  ...  , 

X         1 

(x  +.1),  and  again  the  best  value  of  x  was  foxind.   This  procedure  was 
repeated  until  the  optimal  value  of  x  was  found  accurate  to  the  fourth 
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decimal  place.   The  entire  procedure  was  done  separately  for  each  value 

of  |6J. 

The  following  lemma  proves  that  the  values  of  x  which  are  found 
via  the  grid  search  are  absolute  maximums  for  \Ij  (x)  . 

Lemma  3.2.   Exactly  one  local  maximum  (and  hence  it  is  the  absolute 
maximum)  exists  for  i|;  (x)  in  the  interval  [o ,  1  ]. 


Proof.   By  Theorem  3.3,  only  the  case  Q  >0   needs  to  be  considered. 
From  (3.3.10),  the  first  partial  derivative  of  t]j(x)  with  respect  to  x 
is 

g,  (1  +  x)/2 


''  ^1         2 
e   (6^(1  -  x  )/2  -  2x) 


ti>'(x)   = 


^1    ^1^  0 
(  e   +  e    )" 


^1^         2 
-  e    (S^(l  -  x  )/2  +  2x) 


.   (3.3.16) 


It  can  be  seen  from  (3.3.16)  that  t|j'(0)>0  and  i|;'(l)<0.   Hence  '|;'(x)=0 
for  at  least  one  xeLo,lJ,  and  it  remains  to  be  shown  that  i];'(x)=0  for 
exactly  one  xeLo,lj.   (An  attempt  was  made  to  show  i^"  (x)  is  negative 
for  all  B,  and  xeLo,lj,  but  it  turned  out  not  to  be  true.   In  particular, 
a  graph  of  i|^(x)  as  a  function  of  x  for  3,  =5  indicated  ■4;"(x)>0  for  values 
of  x  near  0 . ) 

From  (3.3.16),  '^j' (x)=0   if  and  only  if 


-S  (1  -  X) 
(6^(1  -  x")/2  -  2x)   =   e  (S^d  -  X  )/2  +  2x) 


(3.3.17) 


Notice  that  the  functions   f  (x)  =  (3  (1  -  x  )/2  -  2x)   and 

f „ (x)  =  (3^(1  -  x')/2   +  2x)   are  reflections  of  each  other  about  the 

axis  x=0,  and  they  are  quadratic  in  x.   Hence  they  intersect  exactly 
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once  at  x=0.   Also,  for  fixed  S, ,  f,  and  f  have  maximums  at  -2/S   and 
2/6  ,  respectively.   Let  g  (x)  be  the  right-hand  side  of  (3.3.17).   It 
was  shown  in  the  preceding  paragraph  that  f  (x)  and  g  (x)  intersect  at 
least  once  in  the  interval  Lo,lJ.   To  determine  that  they  intersect 
exactly  once,  it  is  sufficient  to  show  that   3f  (x)/3x  <  8g  (x)/3x. 
From  (3.3.17) , 


Sf^(x) 


=   -6,x  -  2  , 


3x        "^1 


3g  (x)        -3  (1  -  X)         ,  -6  (1  -  X) 

— ^ —  =   B^e  (3^(1  -  x"')/2  +  2x)  +  e   ^        (-g^x  +  2) 

-6(1  -  X)  2 

=   e   ^        (6^  (1  -  X  )/2  +  6^x  +  2)  . 

For  6  >0  and  xeLo,l],  it  is  clear  that   3f  (x)/3x  <  0  and 
3g  (x)/3x  >  0,  which  completes  the  proof.     t 

Table  3.1  presents  the  optimal  value  of  x  found  from  the  grid 
search  described  immediately  prior  to  Lemma  3.2,  for  various  choices 
of  I  6, I  .   Figure  3.1  is  a  graph  of  the  optimal  value  of  x  versus  I  6,  |  . 
The  table  includes  relatively  large  values  of  |6  !  to  illustrate  that 
x+l  as  |6j'H».   Recall  that  for  a  given  value  of  |S,|,  the  optimal 
design  is  a  comparison  of  (-1,-x)  and  (x,l)  an  equal  niojniber  of  times, 
where  x  is  found  in  Table  3.1  or  Figure  3.1. 

Table  3.1  indicates  that  the  optimal  design  when  S  =0  involves 

only  3  levels,  x=-l,0,l.   However,  when  6  7^0,  the  optimal  design 

requires  4  levels,  x=-l,-x  ,x  ,1,  for  some  x  .   In  certain  experimental 

o   o  o 

situations  it  may  be  significantly  more  laborious  to  make  four  "batches' 
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Table  3.1. 

Designs  which 

minimize  var(S_) 

Relative 

IBJ 

Optimal  X 

efficiency 

0 

0 

1 

.05 

.0003 

1 

.10 

.0012 

1 

.15 

.0028 

1 

.20 

.0050 

1 

.25 

.0077 

.9999 

.30 

.0110 

.9998 

.35 

.0150 

.9995 

.40 

.0194 

.9992 

.45 

.0243 

.9988 

.50 

.0297 

.9982 

.55 

.0356 

.9974 

.60 

.0419 

.9963 

.65 

.0486 

.9950 

.70 

.0556 

.9935 

.75 

.0630 

.9915 

.80 

.0708 

.9893 

.85 

.0787 

.9866 

.90 

.0869 

.9836 

.95 

.0953 

.9801 

1.0 

.1039 

.9761 

1.1 

.1216 

.9668 

1.2 

.1396 

.9556 

1.3 

.1580 

.9426 

1.4 

.1764 

.9269 

1.5 

.1948 

.9097 

1.6 

.2130 

.8905 

1.7 

.2310 

.8696 

1.8 

.2487 

.8472 

1.9 

.2660 

.8233 

2.0 

.2829 

.7983 

3.0 

.4269 

.5242 

4.0 

.5295 

.2974 

5.0 

.6031 

.1546 
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than  it  is  to  make  just  three.   For  this  reason,  and  because  a  priori 
information  about  S,  niay  not  be  available,  asymptotic  relative  efficien- 
cies were  calculated  for  the  design  (n   n  ~  "^n   i    ~   ^/^^  ^°  '^^^  optimal 
designs  found  in  the  table.   The  relative  efficiency  of  the  first  design 
to  the  second  (optimal)  design  is  defined  to  be 

var  (6  ) 
R.E.   =  . 


var^CB^) 


e  -"-/(e  -*•  +  1)^ 


S,(l.x)  6,    6,x 

e         (l-x)/(e   +e    ) 


The  relative  efficiencies  were  enumerated  for  various  choices  of  8  , 
and  are  presented  next  to  the  optimal  designs  in  Table  3.1. 


Equivalence  of  El-Helbawy  and  Bradley's  method 
and  minimizing  the  variance 

An  application  of  El-Helbawy  and  Bradley's  method  for  finding  opti- 
mal designs  was  briefly  discussed  in  Section  1.4.   It  will  now  be  prov- 
en that  their  optimality  criterion  is  equivalent  to  minimizing  var(3,  )/ 
any  k.   First  of  all,  notation  and  results  of  El-Helbawy  and  Bradley's 
paper  which  are  necessary  for  the  proof  of  Theorem  3.5  are  presented. 

Recall  that  El-Helbawy  and  Bradley  considered  linear  contrasts  of 

Y   =  In  ■TT  ,  i=l,  ...  ,t.   The  matrices  B   and  B   are  defined  as  mxt  and 
11  — m     — n 

n^t,  respectively,  with  zero-sum,  orthonormal  rows,  such  that 
0  s.  m  <  m+n  s  t-1.   The  null  hypothesis  is 


H  :   B  Y('^)  =  0   , 
o   — n — n 
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and  the  alternative  hypothesis  is 


H  :   B  Y(TT)  7^  0   , 
a   — n -ra 

where  tt  and  Y(2L)  3xe   column  vectors  with  i   elements  tt.  and  y.,    respec- 
tively.  The  rows  of  B   represent  the  linear  contrasts  ass\imed  to  be 
— m 

null.   Note  that  B  need  not  exist  (i.e.  m=0) . 
— m 

The  vector  it   is  a  value  of  tt  which  satisfies  the  null  hypothesis 
— o  — 

and  the  constraints,  where  tt  is  the  true  parameter  vector. 

The  matrix  B  is  defined  to  be  the  txt  orthonormal  matrix 


B  = 


I'/i/t 


B 
-m 


B* 
-m 


(3.3.18) 


where  B*  is  anv  (t-m-l)xt  matrix  such  that  BB'  =  I  ,  and  l'=(l,  ...  ,1), 
-m      '  —     t      — 

the  t-dimensional  unit  vector. 

The  following  theorem  is  extracted  from  El-Helbawy  and  Bradley 
(1978,  Theorem  2,  page  833) . 

Theorem  3.4.   Let  p  be  the  maximum  likelihood  estimator  of  tt_.   Under 
the  ass\m:iption  of  connectedness  (Assumption  1.2)  ,  and  by  the  assumption 
of  strictly  positive  elements  of  ^,    which  has  already  been  inherently 
assumed  since  ln(0)  is  undefined,  v^(Y(p)  -  y_{Jl))    has  a  limiting  distri- 
bution function  that  is  singular,  t-variate  normal  in  a  space  of  (t-m-1) 
dimensions,  with  zero  mean  vector  and  dispersion  matrix 


E(TT)   =   B*'  (C(^))~^B*  , 
—      -in -m 


(3.3.19) 


where 


52 


C(7r)   =   B*A(77)B*'  ,  (3.3.20) 
— m m 


and  A(TT)  is  the  txt  matrix  with  elements 


V.  .  (TT)   =   77.   ^   1J..TT./(7T.  +  7T  .  )    ,       i=l,...,t, 

11  -       1  Z_j   ID  :    1    3 


j=l 


(3.3.21) 


A   (TT)    =   -y.  .Tr.1T./(7T.  +  TT.)    ,   ifij,     i,j  =  l,...,t, 
•L-j_  2.J     X     J  1       J  '  J  '  '  J         r  t      t 


and  where  u. .  is  defined  in  Assumption  1.2. 

El-Helba;v)Y  and  Bradley's  optimality  criterion  is  the  maximization 

2 
of  the  noncentrality  parameter,  A  ,  for  the  asymptotic  chi-square  dis- 
tribution of  the  likelihood  ratio  statistic.   The  noncentrality  parame- 
ter is 

\^     =      5'Z  "■'•5  ,  (3.3.22) 

—  o  — 

where  6  is  a  vector  of  constants  defined  in  their  paper,  E   is  the 
—  o 

leading  principal  matrix  of  order  n  of  C    ,  B   provides  the  first  n 

— o    — n 

rows  of  B*,  and 
— m 

C   =  B*ACrT  )B*'  .  (3.3.23) 

— o     -TO o  — m 

A  theorem  proving  the  equivalence  of  the  two  optimality  criteria 
is  now  presented. 

2  k 

Theorem  3.5.   Consider  the  model   In  tt  =  S,x+6^x  +  •••  +6,  x  . 
x    1   2  k 

Suppose  we  are  interested  in  testing,  for  some  fixed  i, 


H  :   6.=0  versus  H  :   3 .  ,5^0 

o    1  a    1 


53 

Then  the  design  which  minimizes  var(6.)  is  identical  to  the  design 
which  maximizes  the  noncentrality  parameter  from  the  likelihood  ratio 
test.   (Note  that  it  does  not  matter  whether  or  not  it  is  assumed  that 
some  of  the  other  6  ' s  are  0 . ) 

: 

Proof.   Orthogonal  polynomials  can  be  derived  for  any  spacing  of  the 
independent  variable.   Let  these  contrasts  be  the  rows  of  B.   The  ixt 
matrix  B^^^  is  the  orthogonal  polynomial  corresponding  to  the  parameter 
6.  being  tested. 

From  the  method  used  to  find  orthogonal  polynomials,  it  follows 
that 

where  c  is  a  constant.   So  minimizing  var(6.)  is  equivalent  to  minimiz- 

1 

ing  var(B   ,y(p) ) .   But  from  Theorem  3.4, 
— n=l ' 

^ar{B_y{p))    =      B   .  (B*'  (C(7T)  )"-'-B*)B' 
— n-1 -n=l  -m -m  -n=l 


=      (1,0,  ...  ,0)  (C{^))  ■'" 


=   ((£(£))  ^)^^  . 

2 
From  the  definition  of  X  ,  S   is  the  leading  principal  matrix  of 

order  1  of  C  ~  ,  i.e. 
— o 

^o  =   ((2(1))"')  11  . 
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2 
In  this  case,  6_  is  a  scalar  constant,  and  so  maximizing  A   is  equiva- 
lent to  minimizing  S   =  var(S  ) .     t 
o         1 

Example  3.1.   This  example  illustrates  the  equivalence  of  the  two 

methods  presented  in  Theorem  3.5.   It  is  assumed  that  the  true  model 

2 

is  a  quadratic  model.   In  it  =  6.x  +  B„x  .   Also,  the  design  is  re- 
stricted to  have  the  three  design  points  x=-l,0,l. 

Table  3.1  indicates  that  the  design  which  minimizes  the  variance 

The  design  problem  is  now  approached  using  the  method  presented  by 
El-Helbawy  and  Bradley.   The  null  hypothesis  is 

H  :   6_  =  0  ,   3,  unknown, 
o     2         1 

Using  orthogonal  polynomials,  this  hypothesis  is  equivalent  to 

.'6 

where  y_'  (7T_)  =  (In  t_  ,  In  tt  ,  In  tt  )  . 

Note  that  El-Helbawy  and  Bradley's  constraint,  that  the  In  tt  .  '  s 
sum  to  zero,  poses  no  problem.   Instead  of  constraining  tt   to  be  equal 
to  1,  an  intercept  parameter,  S>    ,    could  be  introduced  to  the  model. 
The  model  would  then  become 

In  TT   =   S„  +  3,x  +  8^x^  , 
X       0     12 

with  the  constraint 

\   In  TT   =  0  . 

X 

2 

It  can  be  shown  in  this  particular  case  that  S^  =  -  ^j- 
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For  a  definition  of  the  following  matrices  and  notation,  see 
(3.3.18)-(3.3.23)  .   For  the  example  under  discussion. 


ln=l  =   (-1   2  -D/Ze    , 


B* 
— m 


(-1   2  -D/v'e 
(-1   0   l)//2 


A(7T  ) 

o 


'^12  ^  ^13 


-y 


12 


-^2 
'l2  ^  ^23 


-U 


-u 


-u 


13 


13 


-y 


23 


23 

^13  ^  ^23 


where  7T^'  =  (1,1,1)  ,  i.e.  8^=62=0.   Note  that  tt^  can  be  any  vector  which 
satisfies  the  null  hypothesis  and  the  constraint. 


The  matrix  C  is 
— o 


C   =   B*A(7T  )B*' 
"~o     -m o  -m 


1    ^^2  "  ^23) 


yn    ^2      23 


Jf  ^^2  -  ^23^      i  (^2  -  %3  ^  ^23) 


implying 


C 
— o 


^^12  ^  ^^13  "■  ^ 


13    ^23' 


■  ;=  ^^12  -  ^23^ 
/12 


■  =  ^^12  -  ^23^ 
/12 


2  ^^12  ^  1^23^ 


— o' 


Then  since  Z^  is  the  upper  left-hand  element  of  C 


-1 


"12  ^  ^^3  "  ^23 
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implying 


-  2  C 


O  U  „  +  4u    +  U 

^12     "^IS    ^^23 


3  ^12^13  ^  ^2^23  ^  ^3'^2_3  _  ^3  3  ^^^ 


12     ^13    ^23 


The  design  which  maximizes  the  chi-square  noncentrality  parameter  from 

the  likelihood  ratio  test  is  the  design  which  maximizes  S 

o 

By  the  definition  of  the  y. .,  y^,  =  1  -  y,^  -  y,,.   So  Z    can  be 

13    23        12    13       o 

rewritten  as 


J  -1   ^   ^2^3  ^  ^^2  ^  ^3^  ^'  -  ^2  -  ^3^ 


y   +4y   +(l-u   -y  ) 
^12     ^13        ^12    ^13 


^12^^  -  ^12  "  ^13^  ^  ^^13  "  ^13^^ 

— 3y^3^  1    -^'  ''•'-''' 


Suppose  that  y    is  temporarily  held  constant.   It  is  then  claimed  that 

choosing  y,_  =  (1  -  y,-)/2  maximizes  T.  for  the  particular  y,^. 

Iz  13  o  13 

From  (3.3.25),  the  expression  y   ( (1  -  y   )  -  y,^)   must  be  maximized. 

Because  of  the  constraint   0  s>  y,  „  <.   l-y   ,  it  is  clear  that 

12       13 

y   ((1  -  u   )  -  y   )  is  maximized  when  y   =  (1  -  ^,3)/^,  which 
proves  the  claim.   The  constraint  among  the  y.  .'s  in  addition  to  the 
above  claim  implies  that  the  optimal  design  must  be  a  design  such  that 


^  -^3 
^2   =   — T^  =   ^23  •  ^'-'-^^ 
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The  scalar  E    is  now  rewritten  as  a  function  of  u,^  alone.   From 
o  12 


(3.3.24)  and  (3.3.26) , 

2 


-1   _   3  ^12^^  -  ^^12^  ^^12 
o       8   2y^2  +  4(1  -  2m^^) 


3  ^12  -  ^^2' 
8    4  -  6U^2 


16   " 

Clearly  Y.  is  maximized  bv  choosing  y._  as  large  as  possible.   By 

o  *  12 

(3.3.26),  this  would  make  U   =u^  =.5,  and  y   =0.   So  this  optimal 
design  is  in  fact  the  same  as  the  design  which  minimizes  var(6  )•     t 

An  attempt  was  made  to  find  the  optimal  design  for  the  test  of 

hypothesis 

H  :   6,  =  6^  =  0      versus      H  :   not  H 
o    1    2  a        o 

using  El-Helbawy  and  Bradley's  methodology.   ^-Jhen  simultaneously  test- 
ing more  than  one  parameter ,  or  equivalently  more  than  one  treatment 

contrast,  a  constant  value,  6.,    must  be  chosen  for  each  parameter.   The 

1 

theory  behind  the  optimal  designs  includes  an  infinite  sequence  of 

values  of  tt  satisfying  H  ,  which  are  converging  to  a  vector  tt   satisfy- 
—  a  — o 

ing  H  .   When  the  treatment  contrasts  are  for  factorial  treatments, 
o 

which  is  the  case  they  discussed  extensively,  the  relative  sizes  of  the 

5 .  are  said  to  be  equivalent  to  the  relative  importance  placed  on  each 

contrast  being  tested  in  H  .   Hence,  El-Helbawv  and  Bradlev  usuallv 

o 

chose  5  =6„=  • • •  =  5  . 
12         n 
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In  the  present  situation,  choosing  5  and  5  restricts  the  alter- 
native parameter  values  in  the  infinite  sequence  mentioned  in  the  pre- 
ceding paragraph  to  be  a  proper  subset  of  the  alternative  parameters 

satisfying  H  .   For  example,  <5  =6   implies  that  B  =&    ,    and  hence  the 

2 
alternative  models  are   In  fr  =  6x  +  6x  ,  with  B^O  as  N-x».   Choosing 

X 

different  6 .  can  result  in  a  different  design  because  the  maximization 
of  the  noncentrality  parameter  depends  on  the  relative  sizes  of  the 
5..   Additionally,  the  optimal  designs  actually  found  after  choosing 
the  relative  sizes  of  6   and  o   were  found  to  be  unreasonable  (e.g.  for 
6  =6  ,  the  optimal  design  is  a  comparison  of  only  the  pair  (-1,0)). 
Chapter  4  presents  other  optimality  criteria  for  fitting  a  quadratic 
mode 1 . 

3.4   Cubic  Model 


The  cubic  model  is 


In  TT. 


?^x.  +  B^x.^  +  S3X.^  ,     i=l t. 


(3.4.1) 


The  asymptotic  variance-covariance  matrix  of  the  maximum  likelihood 

estimators,  B, ,  S^,  and  S,  is  (X  ^)   ,  where  X  ,  is  given  by  (2.3.10) 
1   2       3      ab            ab 

The  inverse  of  the  variance-covariance  matrix  is  partitioned  as 


<V   ■ 


•\l      \2 


12 


13 


22 


13 


23 


33 


Then  by  a  result  found  in  Graybill  (1969,  page  165)  ,  the  variance  of 
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var(e3)   = 


ah   33 


^3   -   '^3   '^23' 


11 


12 


12 


22 


-1 


13 


23 


-1 


33 


\3^\3^22-\2-^23^  "--23^-^23-^2^3^ 
\l'^22  ■  ^2 


-1 


(3.4.2) 


To  simplify  (3.4.2),  only  the  case  S  =0  is  considered  in  the 
search  for  designs  which  minimize  var(S  ).   As  pointed  out  in  Section 
3.1,  this  gives  locally  optimal  designs.   The  following  theorem  shows 
that  optimal  designs  only  need  to  be  found  for  linear  and  quadratic 
parameters  which  are  both  positive. 

Theorem  3.6.   Suppose  that  6^=0,  and  further  that  the  optimal  design 
for  given  6   and  S   is  comparisons  of  the  pairs  (x. ,x  )  a  total  of 
times,  for  all  pairs.   Then 


X.  ,x . 

1  J 


(i)   The  optimal  design  for  (-6^)  and  (-8^)  is  the  same  as  the 
optimal  design  for  3   and  3  , 
(ii)   The  optimal  design  for  (-6^)  and  3   is  comparisons  of  the 
pairs  (-X  ,-x.)  a  total  of  n      times,  for  all  pairs, 

1      J  X.  ,X  .  ir-       f 

....  ^3 

(ill)   The  optimal  design  for  3   and  (-6  )  is  the  same  as  in  (ii) 

Proof.   From  (3.3.5) , 


4)  q    o  (x.  ,x.: 

-3,  ,-3_  1  : 
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exp(-6^(x^+x.)    -  62 (x^  +x.    ))  exp(26^(x^+x.)    +   26^ (x^^+x^^) ) 

(exp(-6,x.-6   x.^)    +  exp(-6,x.-6.x.^))^   exp (26,  (x .+x  . )    +   26_ (x . ^+x . ^) ) 
li2i  lj23  I13  2ij 


2      2 
exp{6  (x   +  X.)  +  S-(x.   +  X   )) 
-^   -^     J      ^   X      J 


2  2   2 

(exp(6,x.  +  6_x.  )  +  exp(6,x.  +  6-X.  )) 
li     2i  1    J  2    J 


=     <t>  (x  ,x  )  .  (3.4.3) 

12      -' 

2 
Notice  that  since  6  =0,   it  .  it  . /  (tt  .  +11.)    from  the  expression  for  X  , 
3      1  ]    1    J  ab 

given  in  (2.3.10)  is  equal  to  1^-      „    (x.,x.).   Hence  bv  (2.3.10)  and 

p^/P2   1   3 

(3.4.3),  it  is  clear  that  A  ,  is  invariant  under  chanaing  the  sign  of 

ab 

both  B   and  6  ,  for  all  a  and  b.   Therefore  the  variance  of  3   is  also 
invariant  under  changing  the  sign  of  both  3   and  6  .   This  implies  that 
the  design  which  minimizes  var(B^)  for  B^  and  3^  is  also  the  design 
which  minimizes  var(6  )  for  (-6  )  and  (-6^),  thereby  proving  (i) . 
To  prove  (ii) ,  note  that  from  (3.3.5), 

2   2 
exp(-6, (x.+x.)  +  S^(x.  +x.  )) 

,       ,     ,  1 1^ 213 

*      (x.  ,x  ^   =  ^ 


^   ^       (exp(-6,x.+S^x.^)  +  exp(-6,x.+8_x.^))^ 

ii2i        i:)23 

2    2 
exp(S,  (-X.-X.)  +  6^(x.  +x.  )) 
^   1    1   J      2   1    : 

(exp(6  (-x.)+S^x.")  +  exp(6, (-x.)+6_x." 
Ii2i  1:2] 


Again,  by  (2.3.10)  and  (3.4.4),  changing  3   to  (-6  )  and  the  pairs 

(x.,x.)  to  (-x.,-x.),  for  all  pairs  in  the  design,  will  not  change  \   , 
131:  ll 

X   ,  ^,,»  nor  \   .   It  changes  only  the  sign  of  A   and  \^  .   But 
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notice  that  in  (3.4.2)  all  terms  involving  A   and  X   are  of  the  form 

-.   .     .,2         2 
12  23'   12  '  °^  23  ■   ^®"^®  th^  negative  sign  cancels,  leaving 

var(B2)  ^"'^^^i^nt  under  the  change  described  above.   This  proves  (ii)  . 
To  prove  (iii) ,  simply  apply  the  results  of  (i)  and  (ii) .     t 

Theorem  3.5  proved  the  equivalence  of  minimizing  var(3  )  and 
El-Helbawy  and  Bradley's  criterion.   A  Fortran  computer  program  was 
used  to  find  the  optimal  design  using  El-Helbawy  and  Bradley's  metho- 
dology for  6^=62=6^=0.   The  levels  allowed  were  x=-l ,-. 5 ,0, . 5, 1.   The 
grid  search  included  all  ten  pairs  formed  by  these  five  levels,  assum- 
ing a  symmetric  design.   The  optimal  design  found  was  ^n 

'  -l,-.5 

".5,1  "  •°'*^^'  ''-55  =  -^^IN,  n     =  .298N,  all  other  n.  .  =  O}. 
For  this  design,  it  can  be  shown  that  var(S  )=16/N. 

It  was  decided  that  for  unequally  spaced  levels,  employing  El-Hel- 
bawy and  Bradley's  methodology  would  be  substantially  more  laborious 
than  minimizing  var(63).  ^°''   ^^^^  reason,  the  designs  subsequently 
discussed  were  found  by  minimizing  the  expression  found  in  (3.4.2). 

Optimal  designs  were  found  by  a  grid  search  via  a  Fortran  computer 
program  for  83=0,  &^,2^=0{ .2)1.      The  comparisons  allowed  were  (-l,x  ), 
'^l'^2^'  ^^'^2'"'"^'  ^'^    (-1/1).  where  the  optimal  value  of  x  and  x  were 
also  found  by  the  computer.   The  motivation  for  the  choice  of  these 
four  pairs  is  the  result  discussed  in  the  two  preceding  paragraphs  for 
the  case  of  all  three  parameters  equal  to  zero,  which  indicated  that 
only  the  pairs  (-l,-.5),  (-.5, .5),  (.5,1),  and  (-1,1)  need  to  be  com- 
pared. 

The  grid  procedure  is  now  briefly  described.   The  initial  values 
for  x^  and  x^  were  x^=-. 7 ( .1) ". 3  and  X2=.3(.l).7.   For  each  of  the  25 
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combinations  of  x  and  x  ,  the  optimal  comparison  proportions  were 
found  by  another  grid.   The  latter  grid  began  by  considering  different 
comparison  proportions,  changing  by  increments  of  0.1.   This  grid 
became  finer  and  finer  until  the  proportions  were  accurate  to  ±.0004. 
From  this  the  best  combination  of  x  and  x  out  of  the  initial  25 
choices  was  fo^md,  and  the  entire  procedure  was  repeated  for  a  finer 
grid  about  the  previous  best  choice  of  x  and  x  .   The  entire  grid 
search  stopped  when  x  and  x  were  accurate  to  ±.0037. 

Notice  that  it  is  possible  that  the  designs  found  are  not  abso- 
lutely optimal,  but  rather  they  may  only  be  local  minimums  for  (3.4.2). 
This  is  because  only  four  pairs  were  considered  when  it  is  possible 
that  a  five  or  six  pair  design,  for  example,  might  offer  a  slight  im- 
provement.  Also,  the  grid  search  restricted  x  and  x^  rather  than 
allowing  them  to  take  on  values  in  the  entire  interval  [-1,1 j.   The 
latter  point  is  not  believed  to  be  a  problem  due  to  the  resulting 
design  for  Q   =B   =Q   =0   originally  found  using  El-Helbawy  and  Bradley's 
methodology,  and  the  fact  that  the  optimal  designs  currently  being  dis- 
cussed all  have  values  of  x  and  x  within  0.02  of  0.5. 

The  optimal  designs  and  the  value  of  var(8^)  for  N=l  are  presented 
in  Table  3.2.   The  first  two  columns  of  the  table  give  the  value  of 
6   and  8  .   Columns  5  through  8  give  the  comparison  proportions  for  the 
pairs  (-l,x  ),  (x  ,x  ) ,  (x  ,1),  and  (-1,1),  respectively,  where  x  and 
X  are  given  in  columns  3  and  4.   The  last  column  gives  N-var(6  ).   The 
number  of  times  a  pair  is  compared  is  found  by  multiplying  the  appro- 
priate comparison  proportion  by  N.   Recall  that  by  Theorem  3.6,  the 
optimal  design  for  both  parameters  negative  is  the  same  as  the  optimal 
design  for  |3  |  and  |3-|.   If  exactly  one  parameter  is  negative,  then 
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the  optimal  design  is  foiand  by  first  finding  the  optimal  design  for 

I  6^  I  and  l&^l  '    ^^^   ^^^"  taking  ]j_     to  be  the  proportion  of  the  total 

nvunber  of  comparisons  that  the  pair  (1 , -x  )  is  compared,  u      to  be 

1  x^,X2 

the  proportion  for  (-x  ,-x  ),  and  so  on.   To  calculate  var(S  )  for  N>1, 

the  tabled  value  of  N-var(3^)  is  divided  by  N. 

Notice  from  Table  3.2  that  for  Q.     '^   .6,  the  optimal  design  is  very 

close  to  the  design  {n_^  .   ^   =  ^_   c,      s'^Sl"  •3333n},  regardless  of 

the  value  of  6  .   This  implies  that  if  it  is  a  priori  believed  that  0 
•^  1 

is  relatively  large,  then  this  design  will  result  in  a  variance  of  6 
very  close  to  the  tabled  minimum.   As  has  been  previously  mentioned,  it 
is  also  of  interest  that  the  optimal  values  of  x   and  x   are  always 
very  close  to  -.5  and  .5,  respectively.   Finally,  notice  that  the 
design  for  3^=6^=0  found  in  Table  3 . 2  is  not  the  same  as  the  one  found 
using  El-Helbawy  and  Bradley's  methodology,  although  the  value  of 
var(6^)  appears  to  be  the  same  for  both,  and  hence  they  are  equally 
optimal.   However,  it  was  not  established  that  the  two  designs  are 
mathematically  equivalent.   Since  the  two  criteria  are  equivalent, 
there  may  be  some  problem  with  local  minimums  of  var(6  ).   It  appears 
that  the  surface  of  the  expression  for  var(6  )  is  relatively  flat,  and 
so  it  is  possible  that  a  finer  initial  grid  is  necessary  to  guarantee 
that  the  minimum  found  is  in  fact  the  absolute  minimum  of  var(6  ). 
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Table  3.2.   Designs  which  minimize  var(6  ) 


h 

^2 

\ 

^2 

"-!,., 

^X   X 

\.i 

^-1,1 

N-varCS^) 

0 

0 

-.50 

.50 

.133 

.533 

.133 

.200 

16.0000 

.2 

0 

-.51 

.50 

.338 

.331 

.331 

0 

16.0836 

.4 

0 

-.50 

.50 

.332 

.337 

.332 

0 

16.3225 

.6 

0 

-.50 

.50 

.330 

.341 

.330 

0 

16.7322 

.8 

0 

-.50 

.50 

.327 

.346 

.327 

0 

17.3190 

1 

0 

-.50 

.50 

.323 

.353 

.323 

0 

18.0959 

0 

2 

-.50 

.50 

0 

.666 

0 

.333 

16.0000 

.2 

2 

-.50 

.51 

.333 

.329 

.338 

0 

16.1447 

.4 

2 

-.50 

.50 

.330 

.336 

.335 

0 

16.3835 

.6 

2 

-.50 

.50 

.329 

.338 

.333 

0 

16.7943 

.8 

2 

-.50 

.50 

.326 

.346 

.328 

0 

17.3819 

1 

2 

-.50 

.50 

.321 

.353 

.327 

0 

18.1604 

0 

4 

-.50 

.50 

0 

.666 

0 

.333 

16.0003 

.2 

4 

-.50 

.50 

.105 

.561 

.103 

.231 

16.3209 

.4 

4 

-.50 

.50 

.330 

.333 

.337 

0 

16.5664 

.6 

4 

-.50 

.50 

.327 

.338 

.335 

0 

16.9799 

.8 

4 

-.51 

.50 

.324 

.342 

.334 

0 

17.5716 

1 

4 

-.51 

.50 

.319 

.349 

.333 

0 

18.3554 

0 

6 

-.50 

.50 

0 

.666 

0 

.333 

16.0005 

.2 

6 

-.50 

.50 

.004 

.661 

.001 

.334 

16.3207 

.4 

6 

-.51 

.50 

.333 

.328 

.340 

0 

16.8748 

.6 

6 

-.51 

.50 

.327 

.333 

.340 

0 

17.2927 

.8 

6 

-.51 

.50 

.323 

.337 

.340 

0 

17.8907 

1 

6 

-.51 

.49 

.317 

.346 

.337 

0 

18.6825 

0 

8 

-.50 

.50 

0 

.666 

0 

.333 

16.0010 

.2 

8 

-.50 

.50 

.004 

.661 

0 

.334 

16.3225 

.4 

8 

-.51 

.47 

.039 

.633 

.078 

.320 

17.2619 

.6 

8 

-.51 

.50 

.328 

.327 

.344 

0 

17.7368 

.8 

8 

-.51 

.50 

.323 

.331 

.346 

0 

18.3436 

1 

8 

-.52 

.49 

.319 

.338 

.343 

0 

19.1472 

0 

1 

-.50 

.50 

0 

.666 

0 

.333 

16.0015 

.  2 

1 

-.50 

.50 

0 

.664 

0 

.335 

16.3233 

.4 

1 

-.51 

.47 

.034 

.633 

0 

.333 

17.2685 

.6 

1 

-.52 

.50 

.331 

.318 

.351 

0 

18.1804 

.8 

1 

-.52 

.50 

.324 

.325 

.351 

0 

18.9372 

1 

1 

-.52 

.49 

.318 

.331 

.351 

0 

19.7558 

CHAPTER  4 
DESIGNS  FOR  FITTING  A  QUADRATIC  MODEL 

4.1   Introduction 

The  present  chapter  contains  optimal  designs  for  fitting  a  quad- 
ratic model  iinder  three  different  conditions,  each  for  three  different 
optimality  criteria.   The  D-optimality  criterion  is  considered  in  Sec- 
tion 4.2.   This  criterion  minimizes  the  determinant  of  the  asymptotic 
variance-covariance  matrix.   In  the  present  chapter,  this  matrix  is  a 
2X2  matrix  since  there  are  two  maximum  likelihood  estimators,  6   and  3  . 
From  Section  2.3,  these  estimators  are  asymptotically  normal.   There- 
fore, by  a  result  in  Box  and  Lucas  (1959),  the  determinant  of  the 
variance-covariance  matrix  is  proportional  to  the  volume  contained  with- 
in any  particular  ellipsoidal  probability  contour  for  &^{B    ,3  )  about 
3^,  where  6   is  the  true  parameter  value.   The  D-optimal  design  will 
then  minimize  the  volume  of  any  such  probability  contour. 

Section  4.3  contains  designs  which  minimize  the  average-variance 
^     -V      '^   2 
°f   In  7T^  =  3  x  +  3-X  .   The  average-variance  is  simply  the  variance  of 

1"  ^x  ^"^^s^^ated  over  the  experimental  region.   In  this  case,  the  exper- 
imental region  is  x£L-l,lJ.   The  property  that  these  designs  have  is 
obvious.   That  is  to  say,  a  good  estimate  of  all  of  the  preference  prob- 
abilities is  desirable,  and  the  design  which  minimizes  the  integral  over 
x  of  vardn  ^  )  will  give  estimates  of  tt  which  are  good  "on  the 

X  X 

average" . 
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The  criterion  discussed  in  Section  4.4  is  similar  to  the  average- 
variance  criterion.   The  designs  found  in  this  section  minimize  the 
maximum  of  var(ln  tt  ),  where  the  maximum  is  taken  over  the  interval 

X 

xeL-lfl].   These  designs  are  referred  to  as  minimax  designs.   The  dis- 
advantage of  this  criterion  is  similar  to  the  disadvantage  often  attrib- 
utable to  the  minimax  rules  in  the  decision  theory  framework.   That  is, 
minimax  designs  may  be  slightly  "pessimistic"  in  the  sense  that  they 
minimize  the  largest  value  that  the  variance  can  be.   This  minimization 
is  good,  but  at  the  same  time  the  variance  of  In  it  may  be  relatively 

X 

large  for  most  values  of  x  in  the  interval  [-1,1  J,  hence  causing  the 
minimax  design  to  be  unfavorable. 

Finally,  Section  4.5  presents  some  design  recommendations  and 
conclusions.   A  number  of  designs  are  compared  to  determine  which 
design  does  best  for  a  wide  range  of  parameter  values,  using  primarily 
the  D-optimality  criterion.   Additionally,  an  examination  is  performed 
on  how  well  these  designs  protect  against  the  bias  present  when  the 
true  model  is  cubic. 

Recall  that  in  general,  the  problem  of  finding  optimal  designs  is 
complex.   It  involves  the  determination  of  the  number  of  levels  to  be 
included  in  the  experimental  design,  and  also  which  particular  levels 
are  to  be  chosen.   Additionally,  the  number  of  times  each  pair  is  to 
be  compared  must  be  determined.   In  Chapter  3  it  was  proven  that  the 
design  which  minimizes  var(3  )  must  be  of  the  form  (n      =  n    =  N/2} 
thereby  implying  that  the  optimal  number  of  levels  is  four,  and  only 
two  pairs  are  to  be  compared  an   equal  number  of  times.   All  that  re- 
mained to  be  resolved  was  the  determination  of  x  for  different  values 
of  |SJ.   In  the  present  situation,  a  similar  simplification  of  the 
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general  problem  does  not  appear  to  be  possible,  except  by  imposing  some 
restrictions,  such  as  letting  6  =0.   For  this  reason,  three  conditions 
are  considered  under  which  optimal  designs  are  found.   This  essentially 
results  in  designs  which  are  optimal  for  a  proper  subclass  of  the  class 
of  all  designs.   However,  as  will  become  apparent  in  the  remainder  of 
the  chapter,  there  is  not  much  difference  in  the  degree  of  optimality 
among  the  three  conditions  presently  considered.   Hence  it  is  conjec- 
tured that  the  degree  of  optimality  of  the  designs  found  in  the  final 
and  most  general  subsection  of  Sections  4.2-4.4  is  very  close  to  if  not 
equal  to  the  best  that  can  possibly  be  achieved.   The  three  conditions 
are  now  briefly  introduced. 

The  first  condition  considered  in  each  of  Sections  4.2-4.4  is  that 
the  levels  are  restricted  to  be  x=-l,0,l.   This  greatly  simplifies  the 
general  problem  to  one  with  only  two  unknowns,  namely  the  comparison 
proportions,  y_^  ^  and  y^  ^.   The  value  of  y     is  found  by  che  rela- 
tionship l^.i  0  "^  ^0  1  "^  '^-1  1  "  ■^' 

The  second  condition  discussed  in  each  of  the  following  three  sec- 
tions is  to  let  6  =0  in  the  enumeration  of  the  variances  and  covariance. 
In  this  situation  the  optimal  designs  are  proved  to  be  symmetric,  and 
hence  the  design  problem  is  simplified  to  a  choice  from  the  class  of 
symmetric  designs.   As  was  pointed  out  in  Section  2.3,  previous  papers 
on  the  design  of  paired  comparison  experiments  have  always  relied  upon 
setting  all  parameters  equal  to  zero.   Presently,  the  linear  parameter 
is  allowed  to  vary.   The  three  criteria  are  a  continuous  function  of 
the  parameters  because  the  variance-covariance  matrix  is  continuous  in 
the  parameters.   Therefore,  the  designs  found  for  the  second  condition 
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are  locally  optimal  in  the  sense  that  they  are  close  to  optimal  for 
values  of  6_  which  are  near  zero. 

The  third  condition  in  each  of  the  following  three  sections  is  a 
consideration  of  designs  whose  comparisons  are  of  the  form  (-l,x  ), 
(x  ,1) ,  and  (-1,1) .   The  optimal  choice  of  the  levels  x  and  x  are 
found  in  addition  to  the  three  comparison  proportions .   This  is  a  gen- 
eralization of  the  first  condition  since  setting  x  =x  =0  results  in  the 
first  condition. 

Figure  4.1  presents  a  synopsis  of  the  procedures  used  in  Sections 
4.2-4.4  to  find  the  optimal  designs  for  each  of  the  three  optimality 
criteria  and  the  three  conditions  introduced  in  the  present  section. 
The  first  coluinn  presents  a  brief  description  of  the  three  conditions, 
and  hence  the  three  rows  in  the  figure  correspond  to  the  three  condi- 
tions.  Columns  2-4  contain  a  brief  description  of  the  methodology  used 
for  the  three  criteria. 

4.2   D-optimal  Designs 

The  D-optimal  design  is  defined  to  be  the  design  which  minimizes 
the  determinant  of  the  asymptotic  variance-covariance  matrix.   Letting 
S  denote  the  variance-covariance  matrix,  this  is  equivalent  to  maximiz- 
ing |Z  ~[.   In  the  case  of  a  quadratic  model,  the  D-optimal  design  is 
the  design  which  maximizes  D,  where 

and  where  '^,,,    '\-_,  and  X   are  given  in  (3.3.2)-(3.3.4).   Because  the 
optimal  design  depends  on  the  true  parameter  values,  designs  are  found 
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for  various  choices  of  the  parameters.   The  three  conditions  intro- 
duced in  Section  4.1  are  now  discussed,  beginning  with  Condition  1. 

Condition  1 

The  levels  are  restricted  to  be  x=-l,0,l.   Because  of  this  restric- 
tion, and  by  substituting  u . .  for  n. .  in  (3. 3. 2) - (3 .3 .4) ,  the  expression 


for  -^-.w  '^1-,/  and  A    can  be  simplified  to 


A     =U    ({)     +uct)    +4U     i 
11      ^-1,0^-1,0    ^0,1^0,1    ^-1,1^-1,1  ' 


12    '^o,ro,i   ^-1,0^-1, 


0  ' 


(4.2.2) 


'^22   =   ^-1,0^-1,0  ■"   %, 1*0,1 


The  substitution  of  y . .  for  n. .  is  made  throughout  the  present  chapter. 
This  essentially  sets  N=l  since  u.  .  =  lim(n.  ./N) . 

From  (4.2.1)  and  (4.2.2),  the  expression  for  D  is 


D  =   4u     u    (t>     (J) 

^-1,0^0,1^-1,0^0,1 


^^^-^-1,0  -  ^0,1^  <^-i, 0^-1,0  ^  ^o,i*o,i)*-i,i  '    (^•^•^) 


where  <t> .  .    is  defined  in  (3.3.5).   The  oartial  derivatives  of  D  with 
respect  to  y     and  y    are,  respectively, 


3U  "^0, 1^-1, 0^^0,1    ^-1,1  "^-1, 0^-1,0    "^0, 1^0,1 

—  i  ,  u 

4(i-y    -u  )'i>        ^  , 

^      -1,0    ^0,1^-1,1^-1,0  ' 


(4.2.4) 


3D 


By 


0,1 


=   ^^^-1,0*-!, 0*0,1  -  ^*-l,l^^-l,0*-l,0  ^  ^0,1*0,1^  ^ 


'*^^  -  ^-1,0  -  ^0,1^*-1, 1^^0,1 


Setting  the  derivatives  in  (4.2,4)  equal  to  zero  results  in 
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(4.2.4) 


u    (2d)    <i>        )   + 

^-1,0^  '-1,0^-1,1^ 


^0,1^-^-1,0^,1  ^  *0, 1^-1,1  ^  *-i,o*-i,i^ 


^-l,0^-*-l, 0*0,1  ^  *-l,0*-l,l  ^  *o,i*-i,i^ 


+  u    (2d)    d)     ] 
*^0,1   ^0,1-1,1 


-1,0-1,1  ' 


'0,1-1,1 


(4.2.5) 


In  matrix  notation,  (4.2.5)  is  equivalent  to 


-1,0 


0,1 


-1,0-1,1  \ 


i)        d) 
'0,1-1,1 


(4.2.5) 


implying 


/  "-.,0  \ 

\    "0,1  / 


=   A 


-1 


-1,0-1,1 


^0,1*-1,1   / 


(4.2.7) 


where 


A  = 


-1,0-1,1 


i)        d)+d)    d)   -i-d)   d) 

^-1,0  0,1   -1,0-1,1   0,1-1,1 


i>        d)  +(j)   i|)   +d)   ({> 

-1,0  0,1   0,1-1,1   -1,0-1,1 


2d)   d) 

0,1-1,1 


For  the  solution  of  (4.2.7)  to  be  a  maximum  for  the  expression  in 
(4.2.3),  it  needs  to  be  shown  that  the  matrix  of  second  order  partial 
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derivatives  is  negative  definite  (see  Kaplan,  page  128).   By  (4.2.4), 
this  matrix  is 


X  = 


^'°/3^-i,o' 


^  °/^^-i,o3%,i 


5'°/3^-i,o3^o,i\ 


''^^'%,l' 


=   -4  A  , 


(4.2.8) 


where,  from  (3.3.5), 


-1,1 


w.     1     1x2 
=  l/(  e    +  e    )   , 


-1,0 


1    "^2  .,     1    "^2    ^  .  2 

/(  e         +  1  )   , 


(4.2,9) 


^1  ^  ^2         ^  ^  ^2   2 


It  is  known  from  elementary  matrix  algebra  that  the  determinant  of 
a  square  matrix  is  equal  to  the  product  of  its  eigenvalues.   So  in  this 
case,  |x|=e  e^,  where  e   and  e   are  the  eigenvalues  of  X.   If  |x|>0, 
then  either  both  eigenvalues  are  positive  or  both  are  negative,  or 
equivalently ,  X  is  either  positive  definite  or  negative  definite.   But 
it  is  clear  from  (4.2.8)  that 


(1    0  )  X 


-l,l'^-l,0 


<   0  , 


(4.2.10) 


where  <t>  and  <i>  are  both  positive  and  are  given  in  (4.2.9)  .   The 

inequality  in  (4.2.10)  implies  that  X  is  negative  definite  if  |x|>0. 
However,  it  will  be  shown  by  (4.2.12)  that  the  determinant  is  not  nec- 
essarily positive  for  all  values  of  6.  and  Q    . 
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To  simplify  the  notation,  we  write 


-2a       -(a  +  c  -  b) 


X  = 


-(a  +  c  -  b) 


-2c 


where 


-1,1-1,0 


-^1  ^  ^2, 
=  e        / 


;  -^1     ^1, ,  -h  "  ^2 

(e    +  e   )  (e         +1) 


b  = 


-1,0^0,1 


=  e   / 


+  1)  (1  +  e  ^    ^) 


-1,1^0,1 


6,  .  6 
=  e       / 


-  -^^  y,        »1  +  «2  ■ 

(e    +  e   )  (1  +  e       ) 


Then  the  determinant  of  X  can  be  written  as 


X|   =  4ac  -  (a  +  c  -  b) 


=  2ac  +  2ab  +  2bc  -  a^  -  b^  -  c^ 


(4.2.11) 


After  resubstituting  for  a,  b,  and  c,  and  after  some  algebra  in 
(4.2.11),  an  expression  for  |x|  is  found  by 


\A 


=   2 


e    +  4e   ^       +  1  +  4e  ^    ^  +  3e   ^    ^ 

B,  +  36     -36-  +  6„      -26-  +  26,     36,  +  3^ 
+  3e       ^   +  e        ^  ^  +  3el       +e^ 

26   +  26       26     -36^  +  36,     36,  +  3, 
+  3e'-     ^  +  3e^  +  e   ^     ^  +   ^      ^  2 


(4,2.12) 


-2f 


^1     ^^1  ^  ^^2     "^^1  ""  ^^2 


+  2e    +  e 


46^  +   26^  -26^  +  462  26  6-    +   26 

+e  +e  +e+2e 
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where 


26^  r  -6,    6,   -6,  +6,         6,  +  8.  -I  2 


2 


1  ,    I.  ,         1     2  .  ,,  ,,     ^1    ^2, 


?  =  4e   /   (e    +  e   ) (e         +  1) (1  +  e       )     .  (4.2.13) 

Since  C>0  for  all  Q      and  6./  |x|>0  if  and  only  if  the  right-hand  side 
of  (4.2.12)  is  positive.   However,  it  appears  that  for  large  enough 
values  of  6   and  S  ,  some  of  the  terms  with  a  negative  sign  will  over- 
whelm the  sum  of  all  of  the  terms  with  a  positive  sign,  and  hence  the 
deteinninant  could  be  negative .   For  example ,  B   ^rid  Q      can  be  made 
large  enough  such  that  the  tejnn  exp(46^  +  2Q    )    in  (4.2.12)  is  larger 
than  the  sum  of  all  the  terms  with  positive  signs,  thereby  making 
the  expression  in  (4.2.12)  negative.   It  will  be  seen  shortly  that  this 
is  in  fact  the  case . 

An  APL  computer  program  was  utilized  to  solve  equation  (4.2.7)  for 
various  values  of  3,  and  3    .      The  determinant,  |x|,  was  also  calculated 
and  found  to  be  positive  for  all  values  of  6   and  3^  when  the  solution 
fell  inside  the  region  of  allowable  values  for  the  comparison  propor- 
tions, U  ,  „,  U.  ,,  and  y  ,  ,.   That  is,  \i .  .    ^0,  for  all  i  and  j,  and 
-1,00,1       -1,1  1 j 

M    n''"^ni  ''"^1    "■'"■   Figure  4.2  depicts  the  values  that  \i  and 

U  can  have.  They  must  lie  inside  or  on  the  solid  triangle.  The 
dotted  triangle  in  the  figure  depicts  the  region  that  the  D-optimal 
designs  are  exclusively  located. 

When  the  solution  to  (4.2.7)  falls  outside  of  the  solid  triangle 
in  Figure  4.2,  the  optimal  design  must  lie  somewhere  on  the  solid  tri- 
angle.  This  can  be  proven  by  contradiction  since  D  is  a  quadratic  func- 
tion of  two  unknowns,  and  hence  it  can  only  have  one  stationary  point. 
For  a  point  to  be  on  the  triangle,  one  of  the  following  must  be  true: 

^-1,0  =  °'  %,1  =  °'  °^  ^-1,0  ^  ^0,1  =  ^- 
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'0,1 


.5 


■1,0 


Figure  4.2.   Depiction  of  possible  designs  for  Condition  1 


If  y_   p.  =  0,  then  from  (4.2.3), 
1 ,  u 


°  =   ^*0,1*-1,1%,1  -^0,1  ^  ' 


and  oD/Sy    =  0   implies  y    =  0,5.   This  clearly  maximizes  D 
because  of  the  negative  coefficient  on  the  quadratic  term.   Therefore 
if  the  optimal  design  lies  on  the  line  segment  y_    =0,  then  it  must 
be  {y^  ^  =  y_^  ^  =  0.5}.   If  ^Q  -,_  =  0,  then 


°  =  "'i'-i, 1^-1,0^^-1,0  -  ^^-1,0  )  ' 


and  it  can  similarly  be  shown  that  the  optimal  design  is  the  midpoint 
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)f  the  line  segment,  namely  {y   ^  =  0,  y     =  y     =  0.5}.   Finally, 


^^   ^-1,0  ^  ^0,1  =  ^'  ^^^^ 


°  =   ^^-1,0^0,1^-1,0*0,1 


^-1,0'^'0, 11^-1,0^^  "^-1,0^ 


Again,  it  can  similarly  be  shown  that  D  is  maximized  when  y     = 
y    =  0.5.   Therefore,  if  the  D-optimal  design  is  on  the  solid  tri- 
angle, it  must  be  one  of  these  three  designs. 

When  the  solution  to  (4.2.7)  was  outside  of  the  solid  triangle  in 
Figure  4.2,  D  was  calculated  for  the  three  designs  presented  in  the 
preceding  paragraph,  and  the  one  with  the  largest  value  of  D  was  taken 
as  D-optimal.   Otherwise  the  D-optimal  design  was  found  directly  from 
(4.2.7).   The  determinant  of  X  was  also  calculated.   It  was  occasion- 
ally negative  as  conjectured  earlier,  but  only  when  the  solution  was 
outside  of  the  region,  at  which  time  the  sign  of  |x|  is  irrelevant. 

The  "restricted"  D-optimal  designs  are  presented  in  Table  4.1  for 

all  combinations  of  the  parameter  values  8  =0(.1)1,2,3  and  B_=0 ( . 1) 1 , 2, 3. 

Recall  that  y  ,  „,  y   , ,  and  y  ,  ,  represent  the  proportion  of  the 
-1,0   0,1       -1,1  j^  j^ 

total  available  comparisons  to  be  allocated  to  the  pairs  (-1,0),  (0,1), 
and  (-1,1),  respectively.   The  number  of  times  one  of  these  three  pairs 
should  be  compared  is  then  found  by  multiplying  the  corresponding  y. . 
by  N.   The  values  of  D  are  also  given  for  the  purpose  of  comparing  the 
designs  with  the  designs  found  in  the  next  two  subsections.   Addition- 
ally, the  relative  efficiencies  are  given  for  the  "restricted"  D-opti- 
mal designs  presented  in  Table  4.1  relative  to  the  D-optimal  designs 
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found  for  Condition  3  in  Table  4.3.   The  relative  efficiency  is  the 

square  root  of  the  ratio  of  the  corresponding  values  of  D,  since  D  is  a 

2 
multiple  of  N  . 

Recall  from  Section  3.1  that  a  value  of  1  for  the  parameter  S   is 
"large".   This  is  basically  true  for  any  parameter  since  x  is  in  the 
interval  [-1,1  J.   For  this  reason,  it  is  assumed  that  rarely  will  6,  or 
S  be  larger  than  1,  and  hence  parameter  values  of  less  than  or  equal  to 
1  are  of  most  interest.   Parameter  values  of  2  and  3  are  included  pri- 
marily to  observe  the  change  in  the  designs  for  large  parameter  values. 

Table  4.1  only  gives  positive  parameter  values.   The  following 
theorem  shows  that  the  table  can  also  be  used  to  find  optimal  designs 
for  negative  values  of  B,  or  B  .   This  theorem  is  similar  to  Theorem 
3.6. 


Theorem  4.1.   Suppose  that  the  D-optimal  design  for  given  B  and  6 

is  a  comparison  of  x.  with  x.  a  total  of  n      times,  for  all  pairs  in 

1     :  X. ,x .  ^ 

the  design.   Then 


(i)   The  D-optimal  design  for  (-B  )  and  (-B  )  is  the  same  as  for 

B^  and  B^, 

(ii)   The  D-optimal  design  for  (-S  )  and  B   is  a  comparison  of 

(-X.)  with  (-X.)  a  total  of  n      times,  for  all  pairs  in 
1  :  X.  ,x .  -^ 

1   ] 
the  design, 

(iii)   The  D-optimal  design  for  S   and  (-B,)  is  the  same  as  in  (ii) 
Proof.   From  (3.4.3), 


,   _n  (x  ,x  )  =      (^  (x.  ,x.)  , 
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where  <j)o   „  (x.,x.)  is  given  in  (3.3.5).   From  (3 . 3.2)  -  (3 .3  .4)  and  the 

6^,62   ^   ^ 

above  result,  it  is  clear  that  A   ,  A   ,  and  X        are  invariant  \inder 

2 

changing  the  sign  of  both  B,  aj^d  B_-   Therefore,  since  D  =  \      X      -X        , 

D  is  invariant  under  changing  the  sign  of  both  Q      and  6  ,  and  so  (i)  is 
proved. 

To  prove  (ii) ,  note  that  by  (3.4.4), 


(X  ,x  )   =  cj)      (-X  ,-x  : 


Again,  from  (3.3.2)-(3.3.4)  and  the  above,  changing  6,  to  (-6  )  and  the 

pairs  (x.,x.)  to  (-x,,-x.)  will  not  change  A,,  nor  A^^.   It  changes 
1   ]         1    ]  11      22 

2 
only  the  sign  of  A   ,  and  hence  does  not  change  A   " .   Therefore  (ii) 

is  proved. 

To  prove  (iii) ,  simply  apply  the  results  of  (i)  and  (ii) .     t 


So,  as  in  Section  3.3,  the  optimal  design  for  both  parameters  nega- 
tive is  the  same  as  the  design  for  |8  I  and  |B^|.   When  exactly  one 
parameter  is  negative,  the  column  headed  y_    becomes  y    ,  and  vice 


Notice  from  Table  4.1  that  for  small  parameter  values,  the  optimal 
design  is  inside  the  solid  triangle  in  Figure  4.2,  signifying  all  three 
pairs  are  to  be  compared.   The  optimal  design  approaches  the  boundary 
as  the  parameters  increase.   Also,  in  all  cases  the  optimal  design  was 
inside  or  on  the  dotted  triangle  in  Figure  4.2,  signifying  that  no  pair 
should  be  compared  more  than  half  of  the  time. 

Notice  also  from  Table  4.1  that  most  of  the  relative  efficiencies 
are  approximately  0.95  when  B   and  S   are  both  less  than  or  equal  to  1. 
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This  indicates  that  the  increase  in  efficiency  for  the  generalization 
considered  under  Condition  3  is  slight.   If  an  experimenter  warrants 
that  a  minim\im  number  of  levels  should  be  used,  then  the  advantage  of 
the  designs  found  presently  under  Condition  1  is  that  they  have  only 
three  levels  as  opposed  to  four  levels  for  the  other  two  conditions. 
The  fact  that  they  are  also  about  95%  efficient  allows  the  present 
designs  to  be  useful  in  this  situation.   However,  if  there  is  no  signi- 
ficant advantage  to  only  having  three  levels,  then  perhaps  the  designs 
found  under  Conditions  2  and  3  are  more  useful  since  they  are  slightly 
more  efficient. 

Condition  2 

In  this  subsection,  locally  D-optimal  designs  are  found  analytical- 
ly for  3  =0.   The  designs  are  local  as  described  in  Section  4.1.   That 
is,  by  the  continuity  of  the  criterion,  the  optimal  designs  are  close 
to  optimal  for  S^  close  to  zero.   It  turns  out  that  they  are  also  local 
in  the  sense  that  the  designs  found  under  Condition  3  have  slightly 
larger  values  of  D  for  some  values  of  S  .   since  the  criterion  is  a 
maximization  of  D,  the  designs  under  Condition  3  are  therefore  occa- 
sionally slightly  better. 

3y  the  same  arginnent  that  was  used  in  the  proof  of  Theorem  3.1, 

the  D-optimal  design  must  be  a  symmetric  design  when  3  =0,  ^ich  implies 

,  2 

^-^2  ^°  ^^^  search  for  a  D-optimal  design  is  reduced  to  a  search 

for  a  symmetric  design  which  maximizes   D  =  a   A   .   Also,  the  proof  of 

Theorem  3.2  can  be  presently  implemented  to  show  that  every  pair  in  the 

D-optimal  design  must  include  either  x=-l  or  x=l. 
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From  (3.3.7),  ({) .  .  is  written  as 


where 


).  .   =   (  4cosh^(6,  (X.  -  x.)/2)  )  ^  , 
ID  1  1    : 


cosh(u)   =  :r  (e  +  e   )  , 


1   u    -u 
sinh(u)   =  —  (e   -  e   ) 


The  maximization  of  D  is  equivalent  to  the  maximization  of  the  follow- 
ing redefined  D: 


where 


D  =   4X^^X22   "   f(x)g(x)  ,  (4.2.14) 


(X)   =  Y 


^/^       (l-x.)2 


f(x)   =   > ,  (4.2.15) 


.  ^  cosh  (3^ (x.  -  l)/2) 
1=1        1   1 


N/2  2         2 

^     (1  -  X.)   (1  +  X.) 


<r — I    1  i.  -  -X  .  ;   I  J.  -!-  A  . 

(x)  =  y  — ^ — - 

^  cosh''(3,  (X.  -  1)/ 


g(x)   =   > ,  (4.2.16) 

'2) 


i=l       ^1   i 


^'   =   ^^l'^2 V2^ 


Two  useful,  easily  verified  facts  are 


3cosh(B  (X.  -  l)/2) 

V^^ =  4  S,sinh(S,  (x.  -  l)/2)  , 

dx.  2   1       1   1 


9sinh(6  (x.  -  l)/2) 

K-^ =  ^  3,cosh(S,  (X.  -  l)/2)  . 

)X .  2   1      1   1 


(4.2.17) 
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The  partial  derivative  of  D  with  respect  to  x .  is  then 


3d_ 
3x. 


9f(x) 
3x. 


3g(x) 


g(x)  +  f(x) 


(4.2.18) 


where 


9f(x) 


-2(1  -  X.) 


3g(x) 


cosh  (6,  (x^  -  l)/2) 


(1  -  X.)  6,sinh(6, (x.  -  l)/2) 
1    1 1   1 

cosh^(6^(x^  -  l)/2) 


(4.2.19) 


4x.   -  4x. 
1      1 


2.  2 


(1  -  x.  )  6,sinh(6, (x.  -  l)/2) 
1    1      1   1 


cosh  (B, (X.  -  l)/2) 
1   1 


cosh  (B, (x.  -  l)/2) 
1   1 


i=l, N/2. 


(4.2.20) 


Because  of  the  complexity  of  handling  these  N/2  equations  of  N/2 
unknowns,  and  because  it  appeared  to  be  reasonable,  the  expression  in 
(4.2.18)  was  evaluated  at  the  N/2-dimensional  point  x.=x,  i=l,,..,N/2, 
set  equal  to  zero  and  solved.   This  produced  a  design  of  two  equally 
weighted  comparisons,  namely  (-1,-x)  and  (x,l),  for  some  x.   The  mechan- 
ics of  the  procediore  follows. 

The  partial  derivative  of  D  with  respect  to  x,,  evaluated  at  x.=x, 
for  all  i,  is 


3d 
3x. 


(4.2.21) 


'.>;here  cosh  and  sinh  are  shorthand  for  cosh  (3  (x  -  l)/2)  and 
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sinh(B, (x  -  l)/2) ,  respectively.   By  setting  the  expression  in  (4.2.21) 

5  3 

equal  to  zero,  multiplying  it  by  cosh  /(N{1  -  x)  (1  +  x) ) ,  and  combin- 
ing terms ,  we  have 


(1  +  3x)cosh  +  B  (1  -  X  )sinh 


(4.2.22) 


Because  of  the  transcendental  nature  of  this  equation,  x  can  not  be 
expressed  as  a  closed  form  function  of  3, •   Consequently,  an  APL  pro- 
gram was  written  to  find  the  solution  to  (4.2.22)  for  various  choices 
of  6  .   These  designs  are  presented  in  Table  4.2  and  are  discussed  at 
the  end  of  the  present  siobsection. 

In  order  for  the  solution  to  (4.2.22)  to  be  a  local  maximum  for  D, 
it  must  be  shown  that 


a^D 


^=°"^ '=°"V2^  Un^ 


1   D 


cosa. 


N/2' 


<   0 


for  any  angles  a.  ,  such  that   0  ^  a.  ^  2tt,  and 
1  1 

N/2 


>  cos  a. 


i=l 


(see  Kaplan,  page  128) .   This  is  equivalent  to  showing  that  the  matrix 
X  is  negative  definite,  where 

/ 


X   = 


^2 

3  D 


ix. ex . 

1  ] 


(4.2.23) 


^i  ^  '  N/2  X  N/2 
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From  (4.2.18),  the  second  order  partial  derivatives  are 


3^0     ^  ^(^^ 


3x. 


3x. 


g(x)  +  2- 


3f(x)  3g(x)       3  g(x) 


3x.    Sj 


+  f(x)- 


,  i=l,...,N/2, 


3x. 

1 


(4.2.24) 


S^D 


3x.  3x . 

1  J 


3^f (x) 


3f(x)  3g(x) 


g(x)  + 


3x.  3x .   —     3x.    3x . 

1  :        1    : 


3f(x)  3g{x) 


3^g(x) 


+  f(x)- 


3x  .    3x.      —  3x .  3x . 
3     1         ID 


3f(x)  3g(x)     3f(x)  3g(x) 


3x .    3x. 
D      1 


.  iT^J,  i,j=l,...,N/2,    (4.2.25) 


where,  from  (4.2.19)  and  (4.2.20), 


3^f(x) 


-^(I-xJ^b/   4(l-x.)6,sinh   |-(l-x.)^S,^sinh^ 
2il,       il       2il 


cosh 


cosh" 


cosh 


(4.2,26) 


9\(x) 


2      1      2  2   2 
4(3x.  -1)  -  ^(1-x.  )  3, 
1 2     1 1 

,2 

cosh 


(x.  -X. ) S, sinh 
111 


cosh' 


3.,    2  2,  2  .  ,2 
—  (l-x.  )  3,  sinh 
2 1 1 

,4 
cosh 


i=l, . . . ,N/2. 
(4.2.27) 


Evaluating  the  second  order  partial  derivatives  at  the  point  x.=x, 
for  all  i,  (4.2.23)  can  be  written  as 


a  b 
b   a 


(4.2.28) 


a  b 


where 


3x/ 


34 


9^f(x) 


8f(x)  9g(x)        9^g(x) 
g(x)  +  2  ^^t: — —  +  f  (x) 


9x.' 


3x.    9x. 


3x.^ 
1  J 


(4.2.29) 


and 


b  = 


3^D 


3x. 3x . 
1  1 


(any  ij^j) 


=   2 


3f(x)  3g(x) 


9x.    3x. 

X        J 


(4.2.301 


The  complete  expressions  for  a  and  b  can  be  found  from  (4.2.29)  and 
(4.2.30),  in  addition  to  (4.2.15),  (4.2.16),  (4.2.19),  and  (4.2.20), 
by  substituting  x  for  x.. 

The  matrix  X  is  of  a  special  form  as  indicated  by  (4.2.28).   It 
can  be  written  as 

X  =   D  +  ayz '  , 


where  D=(a  -  b)  I  .  ,  a=b,  and  y '=z_'=j^'  =  (1 ,  ...  ,1).   From  Graybill 
(page  187,  Theorem  8.5.3),  the  characteristic  equation  is 


N/2 


(d  + 


°'X  ^i'i  " 


^-  1 


A)  (d  -  \) 


=   0  . 


i=l 
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So  (—  -  1)  of  the  eigenvalues  are  d=a-b,  and  one  eigenvalue  is 

d  +  a  Ey.z.  =  (a  -  b)  +  — b.   As  discussed  in  the  previous  subsection, 
.11  2 

1 

the  matrix  X  is  negative  definite  if  and  only  if  all  of  the  eigenvalues 
are  negative.   An  analytic  proof  that  the  two  eigenvalues  are  negative 
follows . 

Consider  first  the  eigenvalue  (a-b) ,  where  from  (4.2.29)  and 
(4.2.30) , 


'"3^f(x) 


a-b  = 


d^gix) 


g(x)  +  f(x) 


3x.' 


x.=x 

1 


2      1      2   2 
cosh  (2  -  -jd-x)  6   )  +  sinh-cosh- (4(l-x)S  ; 

2    3      2   2 
+  sinh  (-  j(l-x)  3^  ) 

_ 
cosh 


N„   2  2 


cosh 


^(1-x) 


cosh 


2      ^      12    2 
cosh  (4(3x  -1)  -  |(l-x  )B^ 

+  sinh-cosh-  (8x(l-x^)  3  )  +  sinh^  (jd-x"^)  ^8^) 


cosh' 


(4.2.31) 


It  needs  to  be  shown  that  (a-b)  is  negative  at  the  stationary  point  x, 
which  is  the  solution  to  (4.2.22).   This  relationship  between  x  and  S 
found  in  (4.2.22)  is  used  in  the  above  expression  of  (a-b)  by  substi- 
tuting for  sinh. 


sinh  = 


-(1  +  3x) cosh 
3^(1  -  x^) 


(4.2.32) 
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Upon  substituting  (4.2.32)  into  (4.2.31),  the  eigenvalue  (a-b)  at  the 
stationary  point,  x,  is 


a-b  = 


/o    1m   ^2Q  2   .  -4(l+3x)    3(l+3x) 


N,n   ,2,,   ,2 
-d-x)  (1+x) 


cosh 


(4(3x^-1)  -  j(l-x^)6^^)  -  8x(l+3x)  +  ■|(l+3x) 


N,-,   x2 
jd-x) 


cosh 

(4.2.33) 


N      2      4 
After  factoring  out  — (1-x)  /cosh   and  combining  terms. 


a-b   <   0 


if  and  only  if 


(4.2.34) 


5^(  -  j(x^  -  1)  (x^  -  2)  )   +   (  -22x^  -  20x  -  6  )   <   0 


The  first  term  in  (4.2.34)  has  roots  x=±l  and  x=±/2,  and  is  nonpositive 
for  xe[-l,l].   The  roots  of  the  second  term  are  imaginary,  and  clearly 
the  function  is  negative  at  x=0.   Hence  it  is  negative  for  all  x.   The 

result  a-b  <  0   then  follows  from  (4.2.34). 

N 
The  second  eigenvalue  is   (a-b)  +  -b.   From  (4.2.19),  (4.2.20), 

and  (4.2.30) , 


^   ^   2d  x)  (_2^osh  -  (l-x)S,sinh)  (-4x(l+x)  cosh  -  (1-x)  (1+x)  "S,  sinh) 
cosh 


2(l-x) 

cosh 


8x(l+x)cosh''  +  2(l-x)(l+x)  3^cosh-sinh 

2  2  2   2"' 

+  4x(l-x  )  3^cosh-f!inh  +  (1-x  )'"3^  sinh'^ 


2(l-x) 

,4 
cosh 


(-x"  +  2x  -  1)  , 


(4.2.35) 


87 


the  last  step  produced  by  again  using  the  relationship  in  (4.2.32)  and 
combining  terms-   Then 

N  ij    ^    i _ (2x  -  2)  .  (4.2.36) 

cosh 

By  factoring  — (1-x)  /cosh  out  of  the  second  eigenvalue,  it  is  clear 
from  (4.2.34)  and  (4.2.36)  that 

(a  -  b)   +  I  b   <   0 


if  and  only  if 


B^(-  ■j(x^-l)  (x^-2))  +  (-22x^-20x-6)  +  (2x-2)    <    0 
if  and  only  if 

6^(-  ■|(x^-l)  (x^-2))  +  (-22x^-18x-8)    <    0   .       (4.2.37) 

The  first  term  in  (4.2.37)  is  unchanged  from  (4.2.34).   The  roots  of 
the  second  term  are  still  imaginary,  and  hence  the  eigenvalue  is  nega- 
tive.  Therefore  X  is  negative  definite,  and  the  solution  to  (4.2.22) 
is  in  fact  a  local  maximum  for  D. 

The  locally  D-optimal  designs  for  6  =0 ( .02) 1, 2  (1) 5  are  presented 
in  Table  4.2.   The  value  of  the  original  D=X   A    is  also  given  for 
comparison  purposes.   By  comparing  the  present  values  of  D  to  the  cor- 
responding values  of  D  associated  with  the  designs  in  Table  4.1,  it  can 
be  seen  that  the  present  designs  offer  a  slight  improvement  for  6„=0. 
Theorem  3.3  is  applicable  here  since  3_=0,  and  so  the  optimal  design 
for  any  particular  value  of  8^  is  the  same  as  the  optimal  design  for 
(-6,) .   Recall  that  for  a  given  6,,  the  optimal  design  is  to  make  half 
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of  the  total  comparisons  between  x  and  1 ,  where  x  is  found  in  the  table , 
and  the  other  half  between  (-x)  and  (-1) .   The  optimal  value  of  x  is 
graphed  as  a  fiinction  of  |B  |  for  |B,|  ^  1  in  Figure  4.3. 

Condition  3 

A  grid  method  was  used  to  find  D-optimal  designs  with  no  restric- 
tions on  the  values  of  the  tMD  parameters.   With  3 y^O,  the  argument  for 
a  symmetric  design  is  no  longer  applicable.   As  a  generalization  of  the 
first  subsection,  the  three  comparisons  (-l,x  ),  (x  ,1),  and  (-1,1) 
were  allowed.   A  description  of  the  grid  method  follows. 

In  general ,  if  there  are  k  independent  unknowns ,  and  the  grid  is 
to  have  n  values  for  each  variable  at  each  stage,  then  the  grid  method 
is  simply  an  evaluation  of  the  function  at  each  of  the  n  points,  and 
the  determination  of  which  of  these  points  maximizes  (or  minimizes)  the 
function.  It  then  repeats  the  procedure,  only  with  a  finer  grid  cen- 
tered at  the  best  point  previously  found.  This  procedure  is  repeated 
until  the  optimal  point  has  been  found  with  sufficient  accuracy. 

The  procedure  used  for  the  present  condition  was  essentially  a 

grid  within  a  grid.   At  each  step,  the  combination  of  three  values  each 

of  X  and  x  were  taken.   Initially  these  values  were  -0.5,  0,  and  0.5. 

For  each  of  these  9  points,  a  grid  method  was  used  on  the  allocation  of 

the  comparisons  to  the  three  pairs.   This  grid  consisted  of  initial 

increments  of  0.1  in  the  allocation  fractions.   Notice  that  this  is  not 

a  full  11   grid  since,  for  example,  {y      =  y     =  u     =  0.5}  is 

— -L,x      X^,l     —1,1 

not  a  possible  allocation  for  the  three  pairs  because  they  must  sum  to 

2 
1.   After  the  best  of  these  possible  allocations  were  found,  a  finer  5 
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grid  was  performed  about  the  current  best  allocation.   Note  that  it  is 

2  3 

a  5  grid  rather  than  a  5  grid,  because  when  two  of  the  allocation 

proportions  are  known,  the  third  is  just  the  sum  of  the  two  proportions 

subtracted  from  1.   This  was  then  repeated  until  the  best  allocation 

fractions  were  accurate  to  ±.0001.   The  best  of  the  9  combinations  of 

2 
X  and  X  was  taken,  and  then  a  finer  3   grid  about  the  current  best 

combination  of  x  and  x^  was  performed  using  the  same  procedure  des- 
cribed in  the  present  paragraph. 

The  entire  procedure  described  in  the  preceding  paragraph  was 
repeated  until  the  values  of  x  and  x  were  also  accurate  to  ±.0001. 
D-optimal  designs  were  found  for  combinations  of  3  =0(.1)1,2,3  and 
62=0 ( .1) 1,2,3,  and  are  presented  in  Table  4.3.   Once  again,  the  value 
of  D  for  N=l  is  also  given  in  the  table.   Notice  from  the  table  that 
when  n    =0,  the  value  of  x  is  immaterial,  and  therefore  an  asterisk 

appears  under  the  column  for  x  . 

2 

Theorem  4.1  is  applicable,  so  designs  for  negative  S   or  3   can 


the 


also  be  found  from  the  table.   If  both  3   and  3   are  negative,  then 

optimal  design  is  identical  to  the  one  for  positive  B  and  3  .   If, 

however,  exactly  one  of  the  parameters  is  negative,  then  the  optimal 

design  is  the  same  as  the  one  for  \B    \  and  |B J,  except  that  n 

changes  to  n     ,  and  n    ,  changes  to  n      .   For  example,  if 
l/-x^       ^2'  -x^,-l 

3^^=0.6,  32=-0.3,  then  the  D-optimal  design  would  be  to  run  .462N  compar- 
isons of  the  pair  (-1,.23),  ,468N  of  the  pair  (-.25,1),  and  .070N  of 
the  pair  (-1,1) . 

Table  4.3  indicates  that  once  again  no  pair  should  be  compared  more 
than  half  the  time.   Also,  the  optimal  design  is  inside  the  region 
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Tabl< 

B    4.1. 

D-optimal  des 

igns  with 

restriction 

x=-l,0,l 

\ 

S 

^-1,0 

^0,1 

^-1,1 

D 

Efficiency 

0 

0 

.333 

.333 

.333 

.083333 

.9613 

.1 

0 

.334 

.334 

.332 

.082506 

.9613 

.2 

0 

.337 

.337 

.327 

.080098 

.9613 

.3 

0 

.341 

.341 

.318 

.076314 

.9612 

.4 

0 

.348 

.348 

.305 

.071460 

.9608 

.5 

0 

.357 

.357 

.287 

.065895 

.9599 

.6 

0 

.369 

.369 

.263 

.059986 

.9583 

.7 

0 

.384 

.384 

.232 

.054068 

.9555 

.8 

0 

.405 

.405 

.190 

.048426 

.9536 

.9 

0 

.433 

.433 

.135 

.043283 

.9542 

1 

0 

.470 

.470 

.060 

.038814 

.9592 

2 

0 

.500 

.500 

0 

.011024 

.9664 

3 

0 

.500 

.500 

0 

.002041 

.7260 

0 

.1 

.333 

.333 

.334 

.083056 

.9615 

.1 

.1 

.336 

.332 

.332 

.082233 

.9617 

.2 

.1 

.340 

.333 

.327 

.079836 

.9615 

.3 

.1 

.345 

.336 

.319 

.076070 

.9613 

.4 

.1 

.353 

.342 

.306 

.071237 

.9610 

.5 

.1 

.362 

.350 

.288 

.065694 

.9602 

.6 

.1 

.374 

.362 

.264 

.059805 

.9585 

.7 

.1 

.389 

.378 

.233 

.053905 

.9558 

.8 

.1 

.409 

.399 

.192 

.048276 

.9538 

.9 

.1 

.435 

.428 

.137 

.043141 

.9543 

1 

.1 

.470 

.467 

.063 

.038676 

.9591 

2 

.1 

.500 

.500 

0 

.011001 

.9660 

3 

.1 

.500 

.500 

0 

.002039 

.7257 

0 

.2 

.332 

.332 

.336 

.082233 

.9619 

,1 

.  2 

.336 

.330 

.334 

.081422 

.9619 

.2 

.2 

.342 

.329 

.329 

.079060 

.9619 

.3 

.2 

.349 

.331 

.321 

.075346 

.9618 

,4 

.2 

.357 

.335 

.308 

.070575 

.9615 

.5 

.2 

.367 

.343 

.291 

.065097 

.9608 

.6 

.2 

.378 

.354 

.268 

.059269 

.9594 

.7 

.2 

.393 

.370 

.237 

.053421 

.9567 

.8 

.2 

.411 

.392 

.197 

.047833 

.9544 

.9 

.2 

.436 

.421 

.143 

.042725 

.9545 

1 

.2 

.468 

.461 

.070 

.038270 

.9587 

2 

.2 

.500 

.500 

0 

.010931 

.9647 

3 

.2 

.500 

.500 

0 

.002034 

.7245 

0 

.3 

.331 

.331 

.338 

.080888 

.9625 

,1 

.3 

.337 

.327 

.337 

.080098 

.9625 

.2 

.3 

.344 

.324 

.332 

.077793 

.9626 

Table  4.1-  continued 
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h 

^2 

^-1,0 

^0,1 

^-1,1 

D 

Efficiency 

.3 

.3 

.352 

.324 

.324 

.074164 

.9626 

.4 

.3 

.361 

.327 

.312 

.069495 

.9625 

.5 

.3 

.371 

.334 

.296 

.064123 

.9619 

.6 

.3 

.382 

.344 

.274 

.058396 

.9607 

.7 

.3 

.396 

.360 

.244 

.052635 

.9582 

.8 

.3 

.413 

.382 

.205 

.047114 

.9556 

.9 

.3 

.435 

.412 

.154 

.042051 

.9550 

1 

.3 

.465 

.452 

.083 

.037616 

.9582 

2 

.3 

.500 

.500 

0 

.010817 

.9624 

3 

.3 

.500 

.500 

0 

.002024 

.7227 

0 

.4 

.329 

.329 

.342 

.079060 

.9633 

.1 

.4 

.337 

.323 

.341 

.078297 

.9634 

.2 

.4 

.345 

.319 

.336 

.076070 

.9635 

.3 

.4 

.354 

.317 

.329 

.072558 

.9637 

.4 

.4 

.364 

.318 

.318 

.068030 

.9637 

.5 

.4 

.374 

.323 

.303 

.062805 

.9634 

.6 

.4 

.385 

.333 

.282 

.057216 

.9625 

.7 

.4 

.398 

.348 

.254 

.051575 

.9604 

.8 

.4 

.414 

.369 

.217 

.046148 

.9574 

.9 

.4 

.433 

.399 

.168 

.041149 

.9559 

1 

.4 

.460 

.440 

.101 

.036744 

.9578 

2 

.4 

.500 

.500 

0 

.010658 

.9593 

3 

.4 

.500 

.500 

0 

.002011 

.7201 

0 

.5 

.327 

.327 

.346 

.076799 

.9643 

.1 

.5 

.336 

.319 

.345 

.076070 

.9644 

.2 

.5 

.347 

.312 

.342 

.073940 

.9647 

.3 

.5 

.357 

.308 

.335 

.070575 

.9650 

.4 

.5 

.367 

.308 

.325 

.066222 

.9653 

.5 

.5 

.378 

.311 

.311 

.061182 

.9653 

.6 

.5 

.389 

.320 

.292 

.055768 

.9647 

.7 

.5 

.400 

.334 

.266 

.050279 

.9631 

.8 

.5 

.414 

.354 

.232 

.044972 

.9599 

.9 

.5 

.432 

.383 

.185 

.040057 

.9574 

1 

.5 

.455 

.423 

.122 

.035695 

.9577 

2 

.5 

.500 

.500 

0 

.010456 

.9551 

3 

.5 

,500 

.500 

0 

.001995 

.7167 

0 

.6 

.324 

.324 

.352 

.074164 

.9655 

.1 

.6 

.336 

.314 

.351 

.073475 

.9656 

.2 

.6 

.348 

.305 

.348 

.071460 

.9660 

.3 

.6 

.359 

.299 

.342 

.068267 

.9665 

.4 

.6 

.371 

.296 

.334 

.064123 

.9670 

.5 

.6 

.381 

.297 

.321 

.059302 

.9674 

Table  4.1  -  continued 
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Sl  ^ 

^-1,0 

^0,1 

^-1,1 

D 

Efficiency 

,6 

6 

.392 

.304 

.304 

.054097 

.9672 

.7 

6 

.403 

.317 

.281 

.048790 

.9661 

.8 

6 

.415 

.336 

.249 

.043628 

.9634 

.9 

6 

.430 

.364 

.206 

.038816 

.9598 

1 

6 

.450 

.403 

.147 

.034511 

.9582 

2 

6 

.500 

.500 

0 

.010213 

.9500 

3 

6 

.500 

.500 

0 

,001974 

.7127 

0 

7 

.321 

.321 

.358 

.071218 

.9667 

.1 

7 

.335 

.308 

.357 

.070575 

.9669 

.2 

7 

.349 

.297 

.355 

.068690 

.9674 

.3 

7 

.362 

.288 

.350 

.065694 

.9681 

.4 

7 

.374 

.283 

.343 

.061787 

.9690 

.5 

7 

.385 

.282 

.333 

.057216 

.9697 

.6 

7 

.396 

.286 

.318 

,052251 

.9700 

.7 

7 

.406 

.297 

.297 

,047154 

.9695 

.8 

7 

.416 

.315 

.269 

,042162 

.967  5 

.9 

7 

,429 

.342 

,229 

.037472 

.9634 

1 

7 

.445 

.379 

.176 

.033239 

.9598 

2 

7 

.500 

.500 

0 

.009931 

.9437 

3 

7 

.500 

.500 

0 

.001950 

,7079 

0 

8 

.318 

.318 

.364 

.068030 

.9680 

.1 

8 

.334 

.302 

.364 

.067436 

.9682 

.2 

8 

.350 

.288 

.362 

.065694 

.9689 

.3 

8 

.365 

.276 

.359 

.062914 

.9699 

.4 

8 

.378 

.268 

.354 

.059269 

.9710 

.5 

8 

.390 

.264 

.346 

.054977 

.9721 

.6 

8 

.400 

.266 

.334 

.050279 

.9729 

,7 

8 

.410 

.275 

.316 

.045413 

.9730 

.8 

8 

.419 

.291 

.291 

.040618 

.9718 

.9 

8 

.429 

.315 

.256 

.036069 

.9683 

1 

8 

.442 

.351 

.208 

.031923 

.9627 

2 

8 

.500 

.500 

0 

.009613 

.9363 

3 

8 

.500 

.500 

0 

.001922 

.7024 

0 

9 

.315 

.315 

.371 

.064663 

.9693 

.1 

9 

.334 

.296 

.371 

.064123 

.9696 

.2 

9 

.352 

.278 

.370 

.062534 

.9704 

.3 

9 

.369 

.263 

.369 

.059986 

.9716 

.4 

9 

.383 

.251 

.365 

.056624 

.9731 

.5 

.9 

.396 

.244 

.360 

.052635 

.9746 

.6 

9 

.406 

.243 

.351 

,048229 

.9759 

.7 

.9 

.415 

.249 

.336 

,043628 

.9765 

.8 

.9 

.423 

.262 

.315 

.039041 

.9761 

Table  4.1  -  continued 
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«! 

^2 

^-1,0 

^0,1 

^-1,1 

D 

Efficiency 

.9 

.9 

.431 

.285 

.285 

.034650 

.9736 

1 

.9 

.440 

.318 

.242 

.030606 

.9673 

2 

.9 

.500 

.500 

0 

.009262 

.9277 

3 

.9 

.500 

.500 

0 

.001890 

.6963 

0 

1 

.311 

.311 

.378 

.061182 

.9705 

.1 

1 

.333 

.289 

.378 

.060698 

.9709 

.2 

1 

.354 

.268 

.378 

.059269 

.9719 

.3 

1 

.373 

.249 

.379 

.056966 

,9734 

.4 

1 

.389 

.233 

.378 

.053905 

.9752 

.5 

1 

.403 

.222 

.375 

.050239 

.9772 

.6 

1 

.414 

.217 

.369 

.046148 

.9789 

,7 

1 

.422 

.219 

.359 

.041828 

.9800 

.8 

1 

.429 

.229 

.342 

.037472 

.9802 

.9 

1 

.435 

.249 

.316 

.033256 

.9786 

1 

1 

.441 

.279 

.279 

.029328 

.9737 

2 

1 

.500 

.500 

0 

.008882 

.9178 

3 

1 

.500 

.500 

0 

.001854 

.6894 

0 

2 

.279 

.279 

.441 

.029328 

.9631 

.1 

2 

.357 

.196 

.448 

.029392 

.9649 

.2 

2 

.430 

.102 

.468 

.029580 

.9704 

.3 

2 

.500 

0 

.500 

.029881 

.9796 

.4 

2 

.500 

0 

.500 

.029897 

.9863 

.5 

2 

.500 

0 

.500 

.029324 

.9857 

.6 

2 

.500 

0 

.500 

.028229 

.9833 

.7 

2 

.500 

0 

.500 

.026706 

.9817 

.8 

2 

.500 

0 

.500 

.024863 

.9809 

,9 

2 

.500 

0 

.500 

.022808 

.9809 

1 

2 

.500 

0 

.500 

.020643 

.9817 

2 

2 

.491 

.255 

.255 

.004495 

.7529 

3 

2 

.500 

.500 

0 

.001307 

.5856 

0 

3 

.262 

.262 

.476 

.011829 

.8470 

.1 

3 

.498 

.002 

.500 

.012236 

.8612 

.2 

3 

.500 

0 

.500 

.012983 

.8864 

.3 

3 

.500 

0 

.500 

.013500 

.9027 

.4 

3 

.500 

0 

.500 

.013767 

.9099 

.5 

3 

.500 

0 

.500 

.013783 

.9083 

.6 

3 

.500 

0 

.500 

.013565 

.9024 

.7 

3 

.500 

0 

.500 

.013142 

.8982 

.8 

3 

.500 

0 

.500 

.012551 

.8955 

.9 

3 

.500 

0 

.500 

.011831 

.8944 

1 

3 

.500 

0 

.500 

.011024 

.8947 

2 

3 

.500 

0 

.500 

.003473 

.7923 

3 

3 

.499 

.251 

.251 

.000618 

.4284 

Table   4.2.      D-optimal    (local)    designs  with   6_=0 
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^1 

Optimal  X 

D 

0 

- 

3333 

.087792 

02 

- 

3333 

.087760 

04 

- 

3330 

.087667 

06 

- 

3326 

.087511 

08 

- 

3321 

.087294 

10 

- 

3314 

.087016 

12 

- 

.3305 

.086678 

14 

- 

3295 

.086282 

16 

- 

.3283 

.085827 

18 

- 

.3270 

.085317 

20 

- 

.3255 

.084751 

22 

- 

.3238 

.084133 

24 

- 

.3221 

.083464 

26 

- 

.3201 

.082745 

28 

- 

.3180 

.081979 

30 

- 

.3158 

,081168 

32 

- 

.3134 

.080315 

34 

- 

.3109 

.079421 

36 

- 

.3082 

.078490 

38 

- 

.3054 

.077523 

40 

- 

.3025 

.076523 

42 

- 

.2994 

.075492 

44 

- 

.2962 

.074434 

46 

- 

.2928 

.073350 

48 

- 

.2894 

.072243 

50 

- 

.2858 

.071116 

52 

- 

.2820 

.069970 

54 

_ 

.2782 

.068809 

\ 

Optimal  X 

D 

56 

- 

2742 

.067635 

58 

- 

.2701 

.066450 

60 

- 

.2660 

.065255 

62 

- 

.2617 

.064054 

64 

- 

.2572 

.062849 

66 

- 

.2527 

.061641 

68 

- 

.2481 

.060432 

70 

- 

.2434 

.059224 

72 

- 

.2386 

.058019 

74 

- 

.2337 

.056819 

76 

- 

.2287 

.055624 

78 

- 

.2237 

.054437 

80 

- 

.2185 

.053258 

82 

- 

.2133 

.052090 

34 

- 

.2080 

.050932 

86 

- 

.2026 

.049787 

88 

- 

.1972 

.048655 

90 

- 

.1917 

.047537 

92 

- 

.1861 

.046434 

Q4 

- 

.1805 

.045346 

96 

- 

.1748 

.044275 

98 

- 

.1691 

.043221 

1 

- 

.1634 

.042183 

2 

.1275 

.011803 

3 

.3383 

.003872 

4 

.4746 

.001561 

5 

.5664 

.000736 
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Table  4.3.   D-optimal  designs 


"l 

^2 

^1 

^2 

"-!,., 

\.i 

^-1,1 

D 

0 

0 

.24 

-.24 

.405 

.405 

.191 

.090170 

.1 

0 

.24 

-.24 

.406 

.406 

.188 

.089275 

.2 

0 

.24 

-.24 

.411 

.411 

.178 

.086675 

.3 

0 

.24 

-.24 

.419 

.419 

.162 

.082605 

.4 

0 

.24 

-.24 

.432 

.432 

.137 

.077413 

.5 

0 

.24 

-.24 

.450 

.451 

.099 

.071512 

.6 

0 

.25 

-.25 

.477 

.477 

.046 

.065324 

.7 

0 

.24 

-.24 

.500 

.500 

0 

.059224 

.8 

0 

.22 

-.22 

.500 

.500 

0 

.053258 

.9 

0 

.19 

-.19 

.500 

.500 

0 

.047537 

1 

0 

.16 

-.16 

.500 

.500 

0 

.042183 

2 

0 

-.13 

.13 

.500 

.500 

0 

.011803 

3 

0 

-.34 

.34 

.500 

.500 

0 

.003872 

0 

.1 

.24 

-.24 

.404 

.404 

.193 

.089846 

.1 

.1 

.24 

-.24 

.406 

.405 

.189 

.088955 

.2 

,1 

.24 

-.24 

.412 

.409 

.180 

.086366 

.3 

.1 

.24 

-.24 

.420 

.417 

.163 

.082312 

.4 

.1 

.24 

-.24 

.433 

.430 

.137 

.077140 

.5 

.1 

.24 

-.24 

.451 

.448 

.101 

.071259 

.6 

.1 

.25 

-.24 

.476 

.475 

.049 

.065090 

.7 

.1 

.25 

-.24 

.500 

.500 

0 

.059009 

.8 

.1 

.23 

-.21 

.500 

.500 

0 

.053070 

.9 

.1 

.20 

-.18 

.500 

.500 

0 

.047375 

1 

.1 

.17 

-.15 

.500 

.500 

0 

.042046 

2 

.1 

-.11 

.15 

.500 

.500 

0 

.011789 

3 

.1 

-.32 

.35 

.500 

.500 

0 

.003872 

0 

.2 

.24 

-.24 

.403 

.403 

.195 

.088884 

.1 

.2 

.24 

-.24 

.405 

.403 

.193 

.088005 

.2 

.2 

.24 

-.24 

.411 

.405 

.184 

.085449 

.3 

.2 

.24 

-.24 

.420 

.413 

.168 

.081445 

.4 

.2 

.24 

-.23 

.432 

.425 

.143 

.076333 

.5 

.2 

.24 

-.24 

.450 

.443 

.107 

.070512 

.6 

.2 

.25 

-.24 

.473 

.470 

.057 

.064396 

.  7 

.2 

.26 

-.24 

.500 

.500 

0 

.058369 

.8 

.  2 

.23 

-.21 

.500 

.500 

0 

.052511 

.9 

.2 

.21 

-.18 

.500 

.500 

0 

.046895 

1 

.2 

.18 

-.14 

.500 

.500 

0 

.041638 

2 

.2 

-.09 

.17 

.500 

.500 

0 

.011747 

3 

-^ 

-.31 

.37 

.500 

.500 

0 

.003874 

0 

.3 

.24 

-.24 

.400 

.400 

.201 

.087317 

.  1 

.3 

.24 

-.24 

.403 

.399 

.198 

.086457 

.  2 

.3 

.24 

-.24 

.410 

.401 

.139 

.083956 
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Table  4.3  -  continued 

^l 

''s 

^1 

^2 

"-!,., 

S-i 

^-1,1 

D 

.3 

.3 

.24 

-.23 

.418 

.407 

.175 

.080035 

.4 

.3 

.24 

-.23 

.430 

.418 

.152 

.075019 

.5 

.3 

.24 

-.23 

.446 

.435 

.119 

.069298 

.6 

.3 

.25 

•-.23 

.468 

.462 

.070 

.063272 

.7 

.3 

.26 

-.23 

.500 

.500 

0 

.057323 

.3 

.3 

.24 

-.20 

.500 

.500 

0 

.051597 

.9 

.3 

.22 

-.17 

.500 

.500 

0 

.046107 

1 

.3 

.20 

-.14 

.500 

.500 

0 

.040969 

2 

.3 

-.07 

.19 

.500 

.500 

0 

.011678 

3 

.3 

-.29 

.39 

.500 

.500 

0 

.003876 

0 

.4 

.24 

-.24 

.396 

.396 

.208 

.085195 

.1 

.4 

.24 

-.24 

.401 

.394 

.205 

.084362 

.2 

.4 

.24 

-.24 

.407 

.395 

.198 

.081937 

.3 

.4 

.24 

-.23 

.416 

.400 

.184 

.078128 

.4 

.4 

.24 

-.23 

.427 

.410 

.163 

.073246 

.5 

.4 

.24 

-.23 

.442 

.426 

.132 

.067663 

.6 

.4 

.25 

-.23 

.462 

.450 

.088 

.061763 

.7 

.4 

.26 

-.22 

.490 

.487 

.024 

.055914 

.8 

.4 

.25 

-.20 

.500 

.500 

0 

.050351 

.9 

.4 

.23 

-.16 

.500 

.500 

0 

.045032 

1 

.4 

.21 

-.13 

.500 

.500 

0 

.040056 

2 

.4 

-.06 

.21 

.500 

.500 

0 

.011582 

3 

.4 

-.27 

.40 

.500 

.500 

0 

.003879 

0 

.5 

.24 

-.24 

.392 

.392 

.217 

.082584 

.1 

.5 

.24 

-.24 

.397 

.389 

.214 

.081784 

.2 

.5 

.23 

-.24 

.404 

.388 

.208 

.079454 

.3 

.5 

.23 

-.23 

.413 

.392 

.195 

.075786 

.4 

,5 

.23 

-.23 

.424 

.399 

.177 

.071074 

.5 

.5 

.24 

-.23 

.437 

.413 

.150 

.065666 

.6 

.5 

,24 

-.22 

.454 

.435 

.111 

.059927 

.7 

.5 

.26 

-.21 

.479 

.469 

.052 

.054207 

.8 

.5 

.26 

-.20 

.500 

.500 

0 

.048806 

.9 

.5 

.24 

-.16 

.500 

.500 

0 

.043697 

1 

.5 

.22 

-.12 

.500 

.500 

0 

.038919 

2 

.5 

-.04 

.23 

.500 

.500 

0 

.011462 

3 

.5 

-.26 

.42 

.500 

.500 

0 

.003883 

0 

.6 

.24 

-.24 

.387 

.386 

.227 

.079560 

.1 

.6 

.24 

-.24 

.393 

.382 

.225 

.078800 

.2 

.6 

.23 

-.24 

.401 

.380 

.219 

.076581 

.3 

.6 

.23 

-.23 

.409 

.381 

.210 

.073082 

.4 

.6 

.23 

-.23 

.420 

.387 

.194 

.068571 

.5 

.6 

.23 

-.22 

.432 

.398 

.170 

.063372 

Table  4.3  -  continued 
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h 

^2 

^ 

^2 

"-!,., 

\.. 

^-1,1 

D 

.5 

.6 

.24 

-.21 

.447 

.417 

.136 

.057829 

.7 

.6 

.25 

-.20 

.466 

.448 

.086 

.052270 

.8 

.6 

.27 

-.19 

.497 

.496 

.007 

.047002 

.9 

.6 

.26 

-.15 

.500 

.500 

0 

.042133 

1 

.6 

.24 

-.11 

.500 

.500 

0 

.037585 

2 

.6 

-.02 

.25 

.500 

.500 

0 

.011317 

3 

.6 

-.24 

.44 

.500 

.500 

0 

.003887 

0 

.7 

.24 

-.24 

.381 

.381 

.237 

.076205 

.1 

.7 

.24 

-.24 

.389 

.375 

.236 

.075489 

.2 

.7 

.23 

-.24 

.398 

.371 

.231 

.073397 

.3 

.7 

.23 

-.23 

.406 

.370 

.224 

.070089 

.4 

.7 

.23 

-.23 

.416 

.373 

.211 

.065809 

.5 

.7 

.23 

-.22 

.427 

.380 

.193 

.060853 

.6 

.7 

.23 

-.21 

.439 

.396 

.165 

.055537 

.7 

.7 

.24 

-.19 

.455 

.422 

.123 

.050170 

.8 

-  .7 

.26 

-.18 

.479 

.465 

.056 

.045038 

.9 

.7 

.27 

-.14 

.500 

.500 

0 

.040377 

1 

.7 

.25 

-.09 

.500 

.500 

0 

.036083 

2 

.7 

-.01 

.27 

.500 

.500 

0 

.011152 

3 

.7 

-.22 

.45 

.500 

.500 

0 

.003891 

0 

.8 

.24 

-.24 

.375 

.375 

.249 

.072601 

.1 

.8 

.24 

-.24 

.385 

.368 

.248 

.071933 

.2 

.8 

.23 

-.24 

.394 

.361 

.245 

.069980 

.3 

.8 

.23 

-.24 

.404 

.357 

.240 

.066884 

.4 

.3 

.22 

-.23 

.413 

.356 

.232 

.062861 

.5 

.8 

.22 

-.22 

.422 

.361 

.217 

.058178 

.5 

.8 

.22 

-.20 

.433 

.371 

.196 

.053122 

.7 

.8 

.23 

-.18 

.445 

.393 

.163 

.047977 

.8 

.8 

.24 

-.16 

.462 

.428 

.110 

.043009 

.9 

.8 

.28 

-.13 

.494 

.489 

.016 

.038471 

1 

.8 

.27 

-.08 

.500 

.500 

0 

.034447 

2 

.8 

.01 

.29 

.500 

.500 

0 

.010966 

3 

.8 

-.21 

.47 

.500 

.500 

0 

.003895 

0 

.9 

.24 

-.24 

.370 

.370 

.260 

.068827 

.1 

.9 

.24 

-.25 

.381 

.359 

.260 

.068211 

.2 

.9 

.23 

-.24 

.391 

.350 

.259 

.066408 

.3 

.9 

.22 

-.24 

.401 

.343 

.256 

.063540 

.4 

.9 

.22 

-.23 

.411 

.338 

.251 

.059796 

.5 

.9 

.21 

-.21 

.419 

.338 

.243 

.055412 

.5 

.9 

.21 

-.19 

.428 

.343 

.229 

.050644 

.7 

.9 

.21 

-.17 

.437 

.359 

.204 

.045752 

.8 

.9 

.22 

-.14 

.449 

.387 

.163 

.040979 
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Table  4.3  -  continued 


h 

S 

^1 

^2 

"-.,x. 

\.i 

^-1,1 

D 

.9 

.9 

.25 

-.11 

.470 

.438 

.092 

.036555 

1 

.9 

.29 

-.06 

.500 

.500 

0 

.032711 

2 

.9 

.03 

.31 

.500 

.500 

0 

.010763 

3 

.9 

-.19 

.48 

.500 

.500 

0 

.003899 

0 

1 

.25 

-.25 

.365 

.365 

.271 

.064957 

.1 

1 

.24 

-.25 

.377 

.351 

.272 

.064396 

.2 

1 

.23 

-.25 

.389 

.339 

.272 

.062750 

.3 

1 

.22 

-.24 

.400 

.327 

.273 

.060123 

.4 

1 

.21 

-.23 

.409 

.319 

.272 

.056677 

.5 

1 

.20 

-.21 

.418 

.312 

.270 

.052615 

.6 

1 

.20 

-.19 

.425 

.312 

.263 

.048163 

.7 

1 

.20 

-.15 

.432 

.321 

.247 

.043553 

.8 

1 

.20 

-.11 

.440 

.342 

.218 

.039005 

.9 

1 

.22 

-.07 

.453 

.383 

.164 

.034727 

1 

1 

.27 

-.04 

.482 

.462 

.056 

.030935 

2 

1 

.05 

.34 

.500 

.500 

0 

.010544 

3 

1 

-.18 

.50 

.500 

.500 

0 

.003902 

0 

2 

.46 

-.46 

.357 

.357 

.286 

.031620 

.1 

2 

.39 

-.53 

.396 

.313 

.292 

.031568 

.2 

2 

.32 

-.60 

.429 

.260 

.311 

.031410 

.3 

2 

.26 

-.67 

.458 

.194 

.349 

.031136 

.4 

2 

.21 

-.74 

.483 

.104 

.413 

.030734 

.5 

2 

.17 

* 

.500 

0 

.500 

.030184 

.6 

2 

.17 

* 

.500 

0 

.500 

.029198 

.7 

2 

.17 

* 

.500 

0 

.500 

.027713 

.8 

2 

.17 

* 

.500 

0 

.500 

.025840 

.9 

2 

.16 

* 

.500 

0 

.500 

.023703 

1 

2 

.15 

* 

.500 

0 

.500 

.021419 

2 

2 

.22 

.53 

.500 

.500 

0 

.007930 

3 

2 

-.02 

.62 

.500 

.500 

0 

.003311 

0 

3 

.71 

-.71 

.444 

.444 

.111 

.016488 

.1 

3 

.66 

-.76 

.459 

.426 

.115 

.016497 

.2 

3 

.61 

-.81 

.471 

.399 

.130 

.016524 

.3 

3 

.55 

-.86 

.482 

.359 

.159 

.016568 

.4 

3 

.50 

-.91 

.491 

.279 

.230 

.016630 

.5 

3 

.44 

* 

.500 

0 

.500 

.016708 

.6 

3 

.43 

* 

.500 

0 

.500 

.016659 

.7 

3 

.42 

* 

.500 

0 

.500 

.016291 

.8 

3 

.40 

* 

.500 

0 

.500 

.015650 

.9 

3 

.39 

* 

.500 

0 

.500 

.014790 

1 

3 

.38 

* 

.500 

0 

.500 

.013771 

2 

3 

.39 

.66 

.500 

.500 

0 

.005532 

3 

3 

.15 

.71 

.500 

.500 

0 

.003369 
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depicted  by  Figure  4.2  for  small  parameter  values,  and  the  designs 
approach  the  boundary  as  the  parameters  become  larger.   Notice  the  pecu- 
liar designs  for  B=2,3   and   .  5  5,  6   ^1.   The  optimal  design  in  this 
case  is  a  comparison  of  only  (-l,x  )  and  (-1,1),  each  N/2  times. 

A  comparison  of  the  designs  in  Table  4.2  with  the  designs  for  B_=0 
in  Table  4.3  shows  that  at  least  some  of  the  designs  found  in  the  pre- 
vious subsection  are  only  locally  optimal.   This  follows  from  the  fact 
that  the  value  of  D  is  larger  in  the  present  subsection  than  it  is  in 
the  previous  subsection  for  B   ^  .6.   Notice  that  the  designs  are  iden- 
tical for  3   ^  .8. 

Based  on  what  has  been  presented  up  to  now,  the  design  D  ={n_ 
=  n      =  .4N,  n_    =  .2n}  is  a  candidate  for  an  overall  efficient 
design.   This  is  reasonably  close  to  all  of  the  optimal  designs  in 
Table  4.3  where  the  parameters  are  both  less  than  or  equal  to  1.   The 
efficiency  of  D  relative  to  the  optimal  designs  is  discussed  in  detail 
in  Section  4.5.   Also  considered  in  Section  4.5  is  the  amount  of  bias 
present  for  design  D  when  the  true  model  is  cubic. 

4.3  Average-variance  Designs 

The  optimality  criterion  discussed  in  this  section  minimizes  V, 
the  average  variance  of  the  predicted  value,  where 


■'  -  r 


vardn  rr  )  dx   .  (4.3.1) 

--1 


The  integral  is  over  the  experimental  region,  which  in  this  case  is 


L-l»lj,  and   In  TT   =  3,x  +  S_x  .   The  variance  of  the  predicted  value. 


In  ir  ,  is 


var  (In  IT  ) 


/  \l  \2 


-1 


(  X   x^  ) 


\  ^2     ^2   I 


^11^22  ■  '^12 


100 


(4.3.2) 


From  (4.3.1)  and  (4.3.2) , 


2  ,        2  , 

1^22   ^  ?\l 

XX   -  X   ^ 
11  22     12 


(4.3.3) 


Three  methods  for  finding  optimal  designs  analogous  to  the  methods  dis- 
cussed in  the  previous  section  for  D-optimal  designs  are  now  discussed. 


Condition  1 

The  levels  are  again  restricted  to  be  x=-l,0,l.   Because  of  the 
complexity  of  V  relative  to  D,  it  was  decided  to  use  a  grid  method  for 
this  condition  rather  than  approach  the  problem  in  a  manner  similar  to 
what  was  done  for  D-optimality .   The  grid  consisted  of  initial  incre- 
ments of  0.1  in  the  allocation  fractions.   After  finding  the  best  of 

2 
the  allocations  above ,  finer  and  finer  5   grids  were  run  until  the 

fractions  were  accurate  to  at  least  ±.001. 

The  procedure  described  in  the  preceding  paragraph  was  performed 

for  all  combinations  of  S  =0(.1)1,2,3  and  3^=0 ( . 1) 1, 2, 3 .   The  designs 

are  presented  in  Table  4.4  along  with  the  value  of  V  for  N=l.   Again, 

efficiencies  of  the  "restricted"  designs  relative  to  the  designs  found 

for  Condition  3  are  given.   In  this  case,  V  is  a  multiple  of  1/N,  so 

the  relative  efficiency  is  defined  to  be  the  ratio  of  the  corresponding 
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values  of  V.   The  relative  efficiencies  are  larger  than  .95  when  3,  and 
6   are  both  less  than  or  equal  to  1,  indicating  that  the  designs  in 
Table  4.4  are  only  slightly  less  efficient  than  the  optimal  designs 
found  in  Table  4.6. 

The  proof  of  Theorem  4.1  is  again  applicable,  and  so  optimal 
designs  for  negative  values  of  S  or  6_  can  be  found  as  before.   That 
is,  optimal  designs  for  negative  3^  and  Q      are  the  same  as  for  |  3-,  |  and 
|3  I •   When  exactly  one  of  the  parameters  is  negative,  the  columns  for 
y     and  \i  effectively  exchange. 

Condition  2 

In  this  si±isection,  local  average-variance  designs  are  found  under 
the  assumption  that  the  true  quadratic  parameter  is  zero.   The  argument 

for  symmetry  is  identical  to  the  one  used  in  Condition  2  for  the  D-opti- 

2 
mality  criterion.   That  is,  reducing  X    reduces  V,  and  so  the  optimal 

design  must  be  symmetric  because  '^,^=0  for  a  symmetric  design.   Then 

from  (4.3.3), 


2/3      2/5  ,^-,.s 

—-     +  -r^—      .  (4.3.4) 

\l      ^22 


Again,  using  a  similar  proof,  it  can  be  shown  that  every  pair  in  the 
optimal  design  must  include  either  x=-l  or  x=l.   Then  from  (4.3.4),  V 
can  be  written 

V   -_   Ml^     .     ill^      ,  ,4.3.5, 

f (x;      g (x) 

where  f(x)  and  g(x)  are  defined  in  (4.2.15)  and  (4.2.16). 
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The  partial  derivative  of  V  with  respect  to  x.  is 


3f  (x) 


3g(x) 


3v 

= 

2  --^±' 

3  3x. 

X 

+ 

2    "■^^-' 
5      3x. 

X 

3x. 

1 

f^(x) 

g^(x) 

(4.3.6) 


where   3f(x)/3x.   and   3g(x)/3x.   are  given  in  (4.2.19)  and  (4.2.20). 

—    X  —    X 

After  evaluating  (4.3.5)  at  the  point  x.=x,  for  all  i,  setting  it  equal 

X 

2     2  3 
to  zero,  and  multiplying  by  N  (1-x  )  /8cosh,  the  locally  optimal  design 

is  found  by  solving 


,2,-,   ,3   4, 

(— (1+x)   +  -rxjcosh  + 


(1-x) (1+x) 


(1-x^) 


S-sinh  =   0  .     (4.3.7) 


The  average-variance  design  is  then  to  use  half  of  the  total  available 
comparisons  to  compare  1  with  x,  where  x  is  the  solution  to  (4.3.7), 
and  the  other  half  to  compare  (-1)  with  (-x) .   Again,  a  computer  pro- 
gram is  necessary  to  solve  (4.3.7)  for  several  values  of  3  . 

It  needs  to  be  shown  that  the  matrix  X  is  positive  definite,  where 


S^v 

/ 

x.=x 

3x. 3x . 

1     : 

From  (4.3.5),  the  second  order  partial  derivatives  are 


3  V 
3x/ 


3^f(x) 


[3f (x; 


f^x) 


f^(x) 


"3^g(x)' 

2 
5 

3x.- 
^          X      -^ 

g"(x) 

"3g(x)" 

"'x . 

X 

g^x) 

(4.3.8) 


i=l, . . . ,N/2, 


= 

4   9f(El) 

3     3x. 

1 

3f  (x) 

+ 

4  9g(£i) 

5     3x. 

1 

3 

g 

3g(x) 

3x.9x . 

1    : 

3x. 

X) 

3x. 

[X) 

where  (4,3.9)  follows  from  the  fact  that 
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^   ,   i,j=l,...,N/2, 


(4.3.9) 


3^f(x) 


dx . ox . 

1   3 


3^g(x) 

3x . 3x , 
1  : 


0  . 


(4.3.10) 


Using  the  same  notation  of  the  previous  section,  (x  -   D  of  the 
eigenvalues  of  x  are 


a  -  b 


0   3^f(x) 

2  3^g(x) 

5      -5      2 
ox. 

1 

3x. 

1 

f^(x) 

g^(x) 

x.=x 

1 


(4.3.11) 


By  factoring  out  4/N  , 


if  and  only  if 


a  -  b   >   0 


"(2  -  |-(l-x)^3^)cosh~  +  4(l-x)6,cosh-sinh 

3      7   T     2 
-  j(l-x)  8^  sinh 


(1-x) 


2       1     ''2   2      ■^ 
(4(3x  -1)  -  ^d-x")  6   )cosh" 

+  8 (x-x  ) 6, cosh' sinh  +  —(1-x  )  8   sinh" 
__ 

(1-x  ) 


>    0  . 


(4.3.12) 


The  remaining  eigenvalue  is 
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N  N 

(a-b)  +  ^   =   (a-b)  +  J 


r- 

2 

4 

3f(x) 

3 

3x. 

X 

_ 

x.=x 

1    _ 

f  (x) 


-72 


8g(x) 


3x. 


x.=x 
1  J 


g(x) 


(4.3.13) 


Once  again  factoring  out  4/N  , 


(a  -  b)   +  J  b   >   0 


if  and  only  if 


r  2 
|-(a-b)  +  j(-2(l-x)cosh  -  (1-x)  ^B^^sinh)  ^/ (1-x)  ^ 

+  |-(4(x^-x)cosh  -  (l-x^)^6,sinh)^/(l-x^)^ 


>   0  , 


(4.3.14) 


where  —(a-b)   is  given  by  (4.3.12). 

An  attempt  was  made  to  use  the  relationship  between  x  and  6^  found 
in  (4.3.7)  to  simplify  (4.3.12)  and  (4.3.14)  in  a  manner  similar  to 
what  was  done  for  D-optimal  designs.   However,  it  did  not  appear  that  a 
useful  substitution  could  be  extracted  from  (4.3.7).   An  APL  computer 
program  solved  (4.3.7)  for  3  =0 ( . 02) 1,2 (1) 5,  and  simultaneously  evalu- 
ated both  eigenvalues.   They  were  both  positive  in  all  cases,  and  so 
the  designs  presented  are  at  least  locally  optimal.   The  designs  are 
presented  in  Table  4.5  along  with  the  value  of  V.   The  optimal  value  of 
X  is  graphed  as  a  function  of  |B  |  in  Figure  4.3.   Again,  Theorem  3.3 
is  applicable,  and  so  the  optimal  designs  for  {-&    )    and  3,  are  identical. 
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Table  4, 

.4. 

Average-variance 

designs 

with  restriction  x=-l,0,l 

61 

^2 

^-1,0 

^0,1 

^-1,1 

V 

Efficiency 

0 

0 

.382 

.382 

.236 

3.655522 

.9562 

.1 

0 

.382 

.382 

.235 

3.671145 

.9563 

.2 

0 

.383 

.383 

.235 

3.718160 

.9565 

.3 

0 

.384 

.383 

.233 

3.796988 

.9568 

.4 

0 

.385 

.385 

.231 

3.908278 

.9571 

.5 

0 

.387 

.387 

.226 

4.052855 

.9570 

.6 

0 

.390 

.390 

.220 

4.231559 

.9563 

.7 

0 

.395 

.395 

.210 

4.445071 

.9549 

.8 

0 

.402 

.402 

.197 

4.693577 

.9535 

.9 

0 

.411 

.411 

.178 

4.976284 

.9525 

1 

0 

.425 

.425 

.150 

5.290571 

.9524 

2 

0 

.500 

.500 

0 

10.159344 

.9918 

3 

0 

.500 

.500 

0 

23.610992 

.8026 

0 

.1 

.382 

.382 

.236 

3.662509 

.9563 

.1 

.1 

.382 

.382 

.236 

3.678149 

.9564 

.2 

.1 

.382 

.383 

.235 

3.725227 

.9567 

.3 

.1 

.382 

.385 

.233 

3.804166 

.9570 

.4 

.1 

.383 

,386 

.231 

3.915628 

.9572 

.5 

.1 

.385 

.389 

.226 

4.060450 

.9572 

.6 

.1 

.387 

.393 

.220 

4.239491 

.9566 

.7 

.1 

.391 

.399 

.211 

4.453456 

.9552 

.3 

.1 

.396 

.407 

.197 

4.702573 

.9538 

.9 

.1 

.405 

.417 

.178 

4.986072 

.9527 

1 

.1 

.417 

.433 

.151 

5.301409 

.9526 

2 

.1 

.481 

.519 

0 

10.184770 

.9909 

3 

.1 

.477 

.523 

0 

23.670074 

.8012 

0 

.2 

.382 

.382 

.236 

3.683503 

.9567 

.1 

.2 

.382 

.382 

.236 

3.699206 

.9568 

.2 

.2 

.382 

.383 

.235 

3.746469 

.9571 

.3 

.2 

.381 

.385 

.234 

3.825734 

.9575 

.4 

.2 

.382 

.387 

.231 

3.937707 

.9578 

.5 

.2 

.382 

.391 

.227 

4.083259 

.9579 

.6 

.2 

.384 

.395 

.221 

4.263307 

.9574 

.7 

.2 

.386 

.402 

.212 

4.478637 

.9562 

.8 

.2 

.390 

.411 

.199 

4.729557 

.9547 

.9 

.2 

.397 

.423 

.181 

5.015437 

.9535 

1 

.2 

.407 

.439 

.154 

5.333891 

.9532 

2 

.  2 

.462 

.538 

0 

10.261279 

.9880 

3 

1 

.455 

.545 

0 

23.847900 

.7969 

0 

.3 

.382 

.382 

.237 

3.718629 

.9572 

.1 

.3 

.381 

.383 

.237 

3.734430 

.9573 

.2 

.3 

.381 

.384 

.236 

3.781997 

.9577 
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Table  4.4 

-  continued 

^1 

^2 

^-1,0 

^0,1 

^-1,1 

V 

Efficiency 

.3 

.3 

.380 

.386 

.235 

3.861807 

.9582 

.4 

.3 

.379 

.389 

.232 

3.974609 

.9587 

.5 

.3 

.379 

.392 

.229 

4.121360 

.9590 

.6 

.3 

.380 

.397 

.223 

4.303068 

.9588 

.7 

,3 

.381 

.405 

.214 

4.520638 

.9577 

.8 

.3 

.384 

.414 

.202 

4.774541 

.9562 

.9 

.3 

.389 

.426 

.185 

5.064346 

.9549 

1 

.3 

.397 

.444 

.159 

5.387944 

.9541 

2 

.3 

.443 

.557 

0 

10.389654 

.9831 

3 

.3 

.433 

.567 

0 

24.146240 

.7899 

0 

.4 

.382 

.382 

.237 

3.768089 

.9580 

.1 

.4 

.381 

.382 

.237 

3.784023 

.9581 

.2 

.4 

.380 

.383 

.237 

3.832005 

.9586 

.3 

.4 

.378 

.386 

.236 

3.912556 

.9592 

.4 

.4 

.378 

.389 

.234 

4.026499 

.9600 

.5 

.4 

.377 

.393 

.231 

4.174885 

.9605 

.6 

.4 

.377 

.398 

.226 

4.358873 

.9607 

.7 

.4 

.376 

.406 

.218 

4.579528 

.9599 

.8 

.4 

.378 

.416 

.206 

4.837540 

.9584 

.9 

.4 

.381 

.429 

.190 

5.132753 

.9568 

1 

.4 

.387 

.448 

.165 

5.463449 

.9556 

2 

.4 

.425 

.575 

0 

10.571164 

.9764 

3 

.4 

.411 

.589 

0 

24.568100 

.7803 

0 

.5 

.381 

.381 

.238 

3.832173 

.9589 

.1 

.5 

.380 

.382 

,238 

3.848271 

.9591 

.2 

.5 

.379 

.383 

.238 

3.896767 

.9596 

.3 

.5 

.378 

.386 

.237 

3.978236 

.9605 

.4 

.5 

.376 

.389 

.236 

4.093597 

.9615 

.5 

.5 

.374 

.393 

.233 

4.244030 

.9624 

.6 

.5 

.373 

.398 

.229 

4.430865 

.9630 

.7 

.5 

.372 

.407 

.222 

4.655393 

.9627 

.8 

.5 

.372 

.417 

.211 

4.918571 

.9613 

.9 

.5 

.373 

.431 

.196 

5.220604 

.9595 

1 

.5 

.377 

.449 

.174 

5.560246 

.9576 

2 

.5 

.407 

.593 

0 

10.807646 

.9676 

3 

.5 

.389 

.611 

0 

25.117706 

.7681 

0 

.6 

,381 

.381 

.239 

3.911265 

.9599 

.1 

.6 

.379 

.382 

.239 

3.927553 

.9601 

'^ 

.6 

.378 

.383 

.239 

3.976645 

.9609 

.3 

.6 

.377 

.385 

.239 

4.059182 

.9619 

,4 

.6 

.375 

.388 

.237 

4.176199 

.9633 

.5 

.6 

.372 

.392 

.236 

4.329037 

.9646 

Table   4.4   -   continued 
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61 

'2 

^-1,0 

^0,1 

^-1,1 

V 

Efficiency 

.6 

.6 

.370 

.398 

.232 

4.519240 

.9656 

.7 

.6 

.367 

.406 

.227 

4.748350 

.9660 

.8 

.6 

.365 

.417 

.218 

5.017673 

.9650 

.9 

.6 

.365 

.431 

.204 

5.327829 

.9629 

1 

.6 

.367 

.449 

.184 

5.678129 

.9604 

2 

.6 

.389 

.611 

0 

11.101451 

.9570 

3 

.6 

.368 

.632 

0 

25.800507 

.7535 

0 

7 

.380 

.380 

.240 

4.005838 

.9610 

.1 

7 

.379 

.382 

.240 

4.022338 

.9613 

.2 

7 

.378 

.383 

.240 

4.072088 

.9622 

.3 

.7 

.376 

.384 

.240 

4.155814 

.9635 

.4 

7 

.373 

.387 

.240 

4.274682 

.9652 

.5 

7 

.370 

.391 

.238 

4.430226 

.9670 

.6 

7 

.367 

.397 

.236 

4.624232 

.9685 

.7 

7 

.363 

.405 

.232 

4.858556 

.9695 

.8 

7 

.360 

.415 

.225 

5.134883 

.9693 

.9 

7 

.358 

.430 

.213 

5.454336 

.9672 

1 

7 

.357 

.448 

.195 

5.816876 

.9639 

2 

7 

.372 

.628 

0 

11.455528 

.9444 

3 

7 

.348 

.652 

0 

26.623413 

.7369 

0 

3 

.380 

.380 

.240 

4.116484 

.9621 

.1 

8 

.379 

.381 

.240 

4.133205 

.9625 

.2 

8 

.378 

.382 

.240 

4.183656 

.9636 

.3 

8 

.375 

.383 

.242 

4.268641 

.9652 

.4 

8 

.372 

.386 

.242 

4.389500 

.9673 

.5 

8 

.369 

.389 

.242 

4.547972 

.9695 

.6 

8 

.365 

.395 

.241 

4.746127 

.9716 

.7 

8 

.360 

.403 

.237 

4.986179 

.9732 

.8 

8 

.356 

.413 

.232 

5.270257 

.9738 

.9 

8 

.351 

.427 

.222 

5.600039 

.9724 

1 

8 

.349 

.444 

.207 

5.976202 

.9685 

0 

8 

.355 

.545 

0 

11.873416 

.9299 

3 

8 

.328 

.672 

0 

27.594589 

.7182 

0 

9 

.380 

.380 

.240 

4.243881 

.9633 

.1 

9 

.379 

.380 

.241 

4.260830 

.9637 

.2 

9 

.377 

.381 

.242 

4.311986 

.9649 

.3 

9 

.375 

.382 

.243 

4.398276 

.9669 

.4 

9 

.372 

.384 

.244 

4.521192 

.9694 

.5 

9 

.368 

.386 

.246 

4.682725 

.9721 

.6 

9 

.363 

.392 

.245 

4.885263 

.9748 

.7 

9 

.357 

.399 

.244 

5.131424 

.9770 

.8 

9 

.352 

.409 

.240 

5.423844 

.9782 
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Table  4.4 

-  continued 

8l 

^2 

^-1,0 

%,1 

^-1,1 

V 

Efficiency 

.9 

.9 

.346 

.422 

.232 

5.764808 

.9777 

1 

.9 

.342 

.440 

.219 

6.155793 

.9740 

2 

.9 

.340 

.661 

0 

12.359278 

.9135 

3 

.9 

.309 

.691 

0 

28.723801 

.6979 

0 

1 

.380 

.380 

.240 

4.388850 

.9643 

.1 

1 

.379 

.380 

.241 

4.406016 

.9648 

.2 

1 

.378 

.379 

.242 

4.457863 

.9663 

,3 

1 

.376 

.380 

.244 

4.545424 

.9686 

.4 

1 

.372 

.381 

.247 

4.670382 

.9715 

.5 

1 

.368 

.383 

.249 

4.835003 

.9748 

.6 

1 

.363 

.387 

.251 

5.042024 

.9780 

.7 

1 

.356 

.394 

.250 

5.294521 

.9807 

.8 

1 

.349 

.403 

.248 

5.595672 

.9825 

.9 

1 

.342 

.415 

.243 

5.948477 

.9826 

1 

1 

.335 

.432 

.233 

6.355247 

.9800 

2 

1 

.324 

.676 

0 

12.918030 

.8954 

3 

1 

.291 

.709 

0 

30.022354 

.6762 

0 

2 

.388 

.387 

.225 

7.091832 

.9494 

.1 

2 

.400 

.372 

.228 

7.106284 

.9499 

.2 

2 

.410 

.354 

.235 

7.150141 

.9515 

.3 

2 

.420 

.333 

.248 

7.224962 

.9541 

.4 

2 

.428 

.306 

.266 

7.333524 

.9580 

.5 

2 

.436 

.275 

.290 

7.480139 

.9631 

.6 

2 

.442 

.239 

.319 

7.671077 

.9693 

.7 

2 

.447 

.198 

.355 

7.915125 

.9761 

.3 

2 

.449 

.155 

.396 

8.224180 

.9827 

.9 

2 

.447 

.116 

.437 

8.613729 

.9891 

1 

2 

.439 

.083 

.478 

9.103029 

.9857 

2 

2 

.194 

.563 

.243 

23.599945 

.6616 

3 

2 

.156 

.844 

0 

56.220154 

.4295 

0 

3 

.410 

.408 

.182 

13.868884 

.7998 

,1 

3 

.461 

.351 

.188 

13.832186 

.8029 

_  2 

3 

.519 

.274 

.207 

13.711627 

.8128 

.3 

3 

.602 

.149 

.249 

13.468477 

.8324 

.4 

3 

.691 

0 

.309 

13.028968 

.8676 

.5 

3 

.672 

0 

.328 

12.626303 

.9848 

.6 

3 

.651 

0 

.348 

12.353458 

.9940 

.7 

3 

.629 

0 

.371 

12.208490 

.9940 

.8 

3 

.603 

0 

.397 

12.193017 

.9943 

.  9 

3 

.578 

0 

.422 

12.311801 

.9952 

1 

3 

.551 

0 

.449 

12.572087 

.9966 

2 

3 

.268 

0 

.732 

28.217896 

.7686 

3 

3 

.086 

.666 

.248 

129.685013 

.2324 

Table  4.5.   Average-variance  (local)  designs  with  3   =0 
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h 

Optimal  X 

V 

0 

- 

.2937 

3 

509664 

02 

- 

2936 

3 

510251 

04 

- 

.2935 

3 

512013 

06 

- 

.2932 

3 

514951 

08 

- 

.2929 

3 

519064 

10 

- 

.2925 

3 

524355 

12 

- 

.2919 

3 

530823 

14 

- 

.2913 

3 

538471 

16 

- 

.2906 

3 

547300 

18 

- 

.2898 

3 

557312 

20 

- 

.2889 

3 

568509 

22 

- 

.2879 

3 

580894 

24 

- 

.2868 

3 

594469 

26 

- 

.2856 

3 

609237 

28 

- 

.2843 

3 

625202 

30 

- 

.2829 

3 

642367 

32 

- 

.2815 

3 

660736 

34 

- 

.2799 

3 

680311 

36 

- 

.2782 

3 

701098 

38 

- 

.2765 

3 

.723100 

40 

- 

2747 

3 

746323 

42 

- 

2728 

3 

770770 

44 

- 

.2708 

3 

796447 

46 

- 

.2687 

3 

823359 

48 

- 

.2665 

3 

851511 

50 

- 

.2642 

3 

880908 

52 

- 

2619 

3 

911555 

54 

_ 

.2595 

3 

943460 

h 

Optimal  X 

V 

56 

- 

.2570 

3 

976627 

58 

- 

.2544 

4 

011062 

60 

- 

.2517 

4 

046773 

62 

- 

.2490 

4 

083764 

64 

- 

.2461 

4 

122042 

66 

- 

.2432 

4 

161614 

68 

- 

.2403 

4 

202487 

70 

- 

.2372 

4 

244667 

72 

- 

.2341 

4 

288160 

74 

- 

.2309 

4 

332974 

76 

- 

.2276 

4 

379116 

78 

- 

.2243 

4 

426592 

80 

- 

.2208 

4 

475409 

82 

- 

.2174 

4 

.525575 

84 

- 

.2138 

4 

.577096 

86 

- 

.2102 

4 

.629979 

88 

- 

.2065 

4 

.684231 

90 

- 

.2028 

4 

.739859 

92 

- 

.1990 

4 

.796871 

94 

- 

.1951 

4 

.355272 

96 

- 

.1912 

4 

915070 

98 

- 

.1872 

4 

975272 

1 

- 

.1832 

5 

038884 

2 

.0599 

10 

076305 

3 

.2832 

18 

950738 

4 

.4370 

31 

519167 

5 

.5402 

47 

666037 

Table  4.6.   Average-variance  designs 
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sl 

^2 

^1 

^2 

"-!,., 

X  ,1    -1,1 

V 

0 

0 

.24 

-,24 

.456 

,455 

088 

3.495387 

.1 

0 

.24 

-,24 

.457 

.456 

087 

3.510654 

.2 

0 

.24 

-,24 

.459 

.459 

082 

3.556512 

.3 

0 

,24 

-.24 

.463 

.463 

074 

3.633069 

.4 

0 

.24 

-.24 

.470 

.470 

061 

3,740429 

.5 

0 

.24 

-.24 

.480 

.480 

040 

3,878488 

.6 

0 

.25 

-.25 

.495 

.495 

010 

4,046638 

.7 

0 

.24 

-.24 

.500 

.500 

0 

4,244664 

.8 

0 

.22 

-.22 

.500 

.500 

0 

4,475407 

.9 

0 

.20 

-.20 

.500 

,500 

0 

4,739857 

1 

0 

.18 

-.18 

.500 

.500 

0 

5,038882 

2 

0 

-.06 

.06 

.500 

.500 

0 

10,076301 

3 

0 

-.28 

.28 

.500 

.500 

0 

18,950729 

0 

.1 

.24 

-.24 

.455 

,455 

089 

3,502490 

.1 

.1 

.24 

-.24 

.455 

,457 

088 

3,517797 

.2 

.1 

.24 

-,24 

.456 

.461 

083 

3.563775 

.3 

.1 

.24 

-.24 

.459 

.466 

075 

3.640539 

.4 

.1 

.24 

-.24 

.464 

,474 

062 

3.748207 

.5 

.1 

,24 

-.24 

.473 

.486 

041 

3.886702 

.5 

.1 

.25 

-.24 

.486 

.503 

012 

4.055433 

.7 

.1 

.24 

-.23 

.490 

.510 

0 

4.254045 

.8 

.1 

.23 

-.21 

.489 

.511 

0 

4.485379 

.9 

.1 

.21 

-.19 

.488 

,512 

0 

4.750462 

1 

.1 

.19 

-.17 

.487 

.513 

0 

5.050146 

2 

.1 

-.03 

.09 

.486 

.515 

0 

10,091684 

3 

.1 

-.26 

.31 

.486 

.514 

0 

18.964417 

0 

.2 

.24 

-.24 

.455 

.455 

090 

3,523829 

.1 

.2 

.24 

-.24 

,453 

.458 

089 

3.539256 

.2 

.  2 

.24 

-.24 

,453 

.463 

085 

3.585588 

.3 

.2 

.24 

-.24 

,454 

.468 

077 

3.662973 

.4 

.2 

.24 

-.24 

,458 

.478 

064 

3,771568 

.5 

.2 

.24 

-,24 

.464 

,490 

046 

3,911353 

.6 

.2 

.25 

-,24 

.475 

.508 

017 

4.081825 

.7 

.2 

.25 

-,23 

.481 

,519 

0 

4.282252 

.8 

.2 

.24 

-.21 

.478 

.522 

0 

4.515371 

.9 

_  2 

.22 

-.19 

.477 

.523 

0 

4.782364 

1 

.2 

.21 

-.16 

.475 

.525 

0 

5.084027 

2 

.2 

-.01 

.11 

.471 

.529 

0 

10,137798 

3 

.2 

-.24 

.33 

,472 

.528 

0 

19.005569 

0 

.3 

.24 

-.24 

,453 

.453 

094 

3.559501 

,1 

.3 

.24 

-.24 

,451 

.457 

092 

3.575117 

.2 

.3 

.24 

-,24 

.449 

.463 

088 

3.622039 

Ill 


Table  4.6  -  continued 
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^2 

^ 

""l 

"-.,., 

\.i 

"-1,1 

V 

.3 

.3 

.24 

-.23 

.449 

.470 

.081 

3.700450 

.4 

.3 

.24 

-.23 

.451 

.480 

.070 

3.810571 

.5 

.3 

.24 

-.23 

.455 

.493 

.052 

3.952484 

.6 

,3 

.25 

-.23 

.463 

.511 

.026 

4.125826 

.7 

.3 

.25 

-.23 

.471 

.529 

0 

4.329484 

.8 

.3 

.24 

-.20 

.468 

.532 

0 

4.565605 

.9 

.3 

.23 

-.18 

.465 

.535 

0 

4.835806 

1 

.3 

.22 

-.15 

.463 

.537 

0 

5.140771 

2 

.3 

.01 

.14 

.456 

.544 

0 

10.214447 

3 

.3 

-.21 

.35 

.458 

.542 

0 

19.074036 

0 

.4 

.24 

-.24 

.452 

.452 

.097 

3.609651 

.1 

.4 

.24 

-.24 

.448 

.457 

.096 

3.625533 

.2 

.4 

.24 

-.24 

.445 

.463 

.092 

3.673269 

.3 

.4 

.24 

-.23 

.444 

.471 

.086 

3.753095 

.4 

.4 

.24 

-.23 

.443 

.481 

.076 

3.865322 

.5 

.4 

.24 

-.23 

.445 

.494 

.061 

4.010170 

.5 

.4 

.25 

-.23 

.450 

.513 

.037 

4.187459 

.7 

.4 

.26 

-.22 

.461 

.538 

.001 

4.396066 

.8 

.4 

.25 

-.20 

.457 

.543 

0 

4.636456 

.9 

.4 

.24 

-.17 

.454 

.546 

0 

4.911190 

1 

.4 

.23 

-.14 

.451 

.550 

0 

5.220799 

2 

.4 

.04 

.16 

.442 

.558 

0 

10.321324 

3 

.4 

-.19 

.37 

.444 

.556 

0 

19.169724 

0 

.5 

.24 

-.24 

.450 

.450 

,101 

3.674506 

.1 

.5 

.24 

-.24 

.445 

.456 

.099 

3.690723 

.2 

.5 

.23 

-.24 

.441 

.462 

.097 

3.739486 

.3 

.5 

.23 

-.23 

.438 

.471 

.092 

3.821097 

.4 

.5 

.23 

-.23 

.436 

.481 

.084 

3.935978 

.5 

.5 

.24 

-.22 

.435 

.494 

.072 

4.084516 

.6 

.5 

.24 

-.22 

.437 

.512 

.051 

4.266764 

.7 

.5 

.26 

-.21 

.444 

.536 

.020 

4.481932 

.8 

.5 

.26 

-.20 

.447 

.553 

0 

4.728442 

.9 

.5 

.25 

-.16 

.442 

.558 

0 

5.009092 

1 

.5 

.24 

-.13 

.438 

.562 

0 

5.324689 

2 

.5 

.06 

.19 

.428 

.572 

0 

10.457992 

3 

_  5 

-.17 

.39 

.431 

.569 

0 

19.292358 

0 

.6 

.24 

-.24 

.447 

.448 

.105 

3.754354 

.1 

.6 

.24 

-.24 

.442 

.454 

.104 

3.770972 

.2 

.6 

.23 

-.24 

.437 

.462 

.102 

3.820965 

.3 

.6 

.23 

-.23 

.432 

.469 

.099 

3.904708 

.4 

.6 

.23 

-.23 

.428 

.479 

.093 

4.022751 

.5 

.6 

.23 

-.22 

.425 

.493 

.083 

4.175665 

Ta±ile   4.6   -   continued 
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h 

^2 

^ 

^2 

-^-x 

\.. 

^-1,1 

V 

.6 

5 

.24 

-.21 

.424 

.509 

.067 

4.363788 

.7 

6 

.25 

-.20 

.427 

.532 

.041 

4.586706 

.8 

6 

.27 

-.19 

.437 

.563 

0 

4.842248 

.9 

6 

.26 

-.16 

.431 

.569 

0 

5.130244 

1 

6 

.26 

-.12 

.427 

.574 

0 

5.453180 

2 

5 

.08 

.22 

.414 

.586 

0 

10.623909 

3 

6 

-.14 

.41 

.417 

.583 

0 

19.441772 

0 

7 

.24 

-.24 

.446 

.446 

.109 

3.849566 

.1 

7 

.24 

-.24 

.439 

.452 

.109 

3.866647 

.2 

7 

.23 

-.24 

.432 

.459 

.109 

3.918055 

.3 

7 

.23 

-.23 

.426 

.468 

.106 

4.004243 

.4 

7 

.23 

-.23 

.420 

.477 

.102 

4.125902 

.5 

7 

.23 

-.22 

.415 

.490 

.095 

4.283813 

.6 

7 

.23 

-.21 

.411 

.505 

.084 

4.478602 

.7 

7 

.24 

-.19 

.410 

.525 

.066 

4.710282 

.8 

7 

.26 

-.18 

.415 

.554 

.032 

4.977325 

.9 

7 

.28 

-.15 

.420 

.580 

0 

5.275561 

1 

7 

.27 

-.10 

.415 

.585 

0 

5.607162 

2 

7 

.11 

.24 

.401 

.599 

0 

10.818448 

3 

7 

-.12 

.43 

.405 

.595 

0 

19.617645 

0 

8 

.24 

-.24 

.443 

.443 

.114 

3.960589 

.1 

8 

.24 

-.24 

.436 

.450 

.114 

3.978189 

_2 

8 

.23 

-.24 

.429 

.458 

.114 

4.031176 

.3 

8 

.23 

-.24 

.421 

.465 

.114 

4.120092 

.4 

8 

.22 

-.23 

.414 

.475 

.112 

4.245771 

.5 

8 

.22 

-.22 

.406 

.485 

.109 

4.409204 

.6 

8 

.22 

-.20 

.399 

.498 

.103 

4.611306 

.7 

8 

.23 

-.18 

.394 

.515 

.091 

4.852514 

.8 

8 

.24 

-.16 

.393 

.540 

.067 

5.131998 

.9 

8 

.28 

-.13 

.402 

.579 

.018 

5.445721 

1 

8 

.29 

-.09 

.403 

.597 

0 

5.787655 

2 

8 

.13 

.27 

.388 

.612 

0 

11.040878 

3 

8 

-.10 

.45 

.392 

.608 

0 

19.819672 

0 

9 

.24 

-.24 

.441 

.441 

.118 

4.087960 

.1 

9 

.24 

-.25 

.434 

.449 

.118 

4.106125 

_  2 

9 

.23 

-.24 

.425 

.456 

.119 

4.160837 

.3 

9 

.22 

-.24 

.417 

.463 

.121 

4.252724 

.4 

9 

.22 

-.23 

.408 

.471 

.122 

4.382762 

.5 

9 

.21 

-.21 

.398 

.479 

.123 

4.552135 

.6 

9 

.21 

-.19 

.389 

.489 

.122 

4.762028 

.7 

9 

.21 

-.17 

.380 

.503 

.117 

5.013263 

.8 

9 

.22 

-.14 

.375 

.523 

.102 

5.305647 

113 


Table  4.6  -  continued 

\ 

^ 

\ 

"2 

"-!.., 

\.. 

"-1,1 

V 

.9 

.9 

.25 

-.10 

.375 

.555 

.069 

5.636459 

1 

.9 

.31 

-.07 

.392 

.608 

0 

5.995749 

2 

.9 

.15 

.30 

.376 

.624 

0 

11.290431 

3 

.9 

-.08 

.47 

.379 

.621 

0 

20.047470 

0 

1 

.25 

-.25 

.439 

.440 

.121 

4.232290 

.1 

1 

.24 

-.25 

.431 

.447 

.122 

4.251060 

.2 

1 

.23 

-.25 

.423 

.453 

.124 

4.307615 

.3 

1 

.22 

-.24 

.413 

.460 

.127 

4.402675 

.4 

1 

.21 

-.23 

.403 

.466 

.132 

4.537338 

.5 

1 

.20 

-.21 

.392 

.472 

.136 

4.712965 

.6 

1 

.20 

-.19 

.380 

.480 

.141 

4.930936 

.7 

1 

.20 

-.15 

.369 

.489 

.142 

5.192368 

.8 

1 

.20 

-.11 

.359 

.505 

.136 

5.497597 

.9 

1 

.22 

-.07 

.354 

.529 

.117 

5.845107 

1 

1 

.27 

-.04 

.360 

.577 

.063 

6.228132 

2 

1 

.17 

.32 

.364 

.636 

0 

11.566305 

3 

1 

-.06 

.48 

.368 

.633 

0 

20.300705 

0 

2 

.46 

-.46 

.490 

.490 

.021 

6.733291 

.1 

2 

.39 

-.53 

.493 

.489 

.018 

6.750583 

.2 

2 

.32 

-.60 

.497 

.492 

.010 

6.803201 

.3 

2 

.26 

-.66 

.499 

.501 

0 

6.893327 

.4 

2 

.20 

-.72 

.496 

.504 

0 

7.025329 

.5 

2 

.14 

-.76 

.493 

.507 

0 

7.204350 

.6 

2 

.10 

-.81 

.488 

.512 

0 

7.435870 

.7 

2 

.05 

-.85 

.482 

.518 

0 

7.725970 

.8 

2 

.01 

-.88 

.476 

.524 

0 

8.081570 

,9 

2 

-.02 

.34 

.416 

.176 

.409 

8.520247 

1 

2 

-.03 

.37 

.399 

.173 

.428 

8.972814 

2 

2 

.35 

.53 

.269 

.731 

0 

15.613154 

3 

2 

.14 

.62 

.270 

.730 

0 

24.145706 

0 

3 

.60 

-.60 

.500 

.500 

0 

11.092550 

.1 

3 

.55 

-.64 

.504 

.497 

0 

11.105566 

.2 

3 

.50 

-.69 

.507 

.493 

0 

11.144773 

.3 

3 

.45 

-.73 

.511 

.489 

0 

11.210546 

.4 

3 

.40 

-.78 

.516 

.484 

0 

11.303552 

.5 

3 

.24 

.53 

.471 

.249 

.281 

12.434281 

.6 

3 

.16 

.54 

.581 

.070 

.349 

12.279836 

.7 

3 

.12 

* 

.608 

0 

.392 

12.135128 

.8 

3 

.11 

* 

.584 

0 

.416 

12.123116 

.9 

3 

.09 

* 

.560 

0 

.440 

12.253007 

1 

3 

.08 

* 

.536 

0 

.464 

12.528843 

2 

3 

.48 

.66 

.209 

.791 

0 

21.688461 

3 

3 

.29 

.71 

.208 

.792 

0 

30.141708 
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Condition  3 

A  grid  method  identical  to  the  one  described  in  Condition  3  for 
D-optimal  designs  is  used  to  minimize  V  in  (4.3.3).   The  optimal  designs 
are  presented  in  Table  4.6.   Theorem  4.1  is  again  applicable,  and  so 
optimal  designs  for  negative  values  of  B,  or  Q      can  be  found  in  the 
manner  described  in  Condition  3  of  Section  4.2. 

Notice  that  the  pattern  of  the  designs  in  Table  4.6  is  similar  to 

the  D-optimal  designs  in  Table  4.3.   However,  it  is  no  longer  true  that 

eveiry  pair  is  compared  no  more  than  half  the  time.   Also,  for  S_  ^  1, 

the  change  in  x  .  x^,  y  ^    ,  y    , ,  or  u  ,  ,  found  in  Table  4.6  is 
1    2    "-'•'^1    X  ,1      -1,1 

monotone  as  a  function  of  S  .   For  3_=2  or  6-=3,  however,  this  is  not 

the  case.   For  example,  notice  the  large  difference  between  the  optimal 

design  for  6  =.8,  3_=2  and  the  optimal  design  for  3  =.9,  S_=2. 

Once  again  a  comparison  of  the  designs  in  Table  4.5  with  the 

designs  for  S  =0  in  Table  4.6  shows  the  designs  found  in  the  preceding 

subsection  result  in  only  local  minimums  for  V  when  |B  |  ^  .6.   The 

corresponding  designs  found  presently  are  superior  because  of  the 

smaller  value  of  V. 

4.4   Minimax  Designs 

This  section  is  a  consideration  of  designs  which  minimize  the  max- 
imum value  of  vardn  t  )  over  x£L-l,lJ.   The  designs  are  referred  to  as 

X 

minimax  designs.   From  (4.3.2),  the  minimax  design  minimizes 


max   vardn  it  )   =     max 

xeL-l,lj       ^     xeL-l,lJ 


x"(A,,  -  2xA^^  +  x-A.^^) 

'll  22  ~  ■ 12 


(4.4.1) 


115 


The  following  theorem  simplifies  (4.4.1). 

Theorem  4.2.   Given  a  quadratic  model.   Then  var(ln  ir  )  is  a  maximum 
X 

over  xe[-l,l]  at  x=±l. 
Proof.   Note  that 


22 


-X. 


12 


'2  I 


12 


11 


\l'"^22  "  ^2^ 


Case  1:   A    <.  0. 


var  (In  tt  ) 


var(B^  +  62) 


^22  ^  \l   -  ^^2 

/\  A   -  A   ^ 
11  22     12 


\l'^22  -  ^2 


(-1  s.  x  s  1) 


Case  2:   A    >  0. 
12 


var  (In  tt 


var  (In  tt 


var(62  "  ^1^ 


\l   "  -^22  "  ^\2 
\l'S2  -  ^2 


x''(A,  x"  +  A^^  +  2A_x) 
11 22 12 

A   A   -  A  ^ 
11  22     12 


(-1  s  X  s  1) 
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var  (In  tt  ) 

X 


From  the  preceding  theorem,  the  minimax  design  is  the  design  which 


minimizes 


^22  -  2^2  ^  \l  \2   ^  2^2  -^  \l 


L  '^1^22  "  '^2^ 


\l^22  ■  ^12^ 


^22-^1^2!  '\l 
2 
^1^2  ■  \2 


(4.4.2) 


Three  conditions  are  again  briefly  discussed.   The  procedures  for  the 

three  conditions  are  very  similar  to  the  procedures  described  for 

average-variance  designs  because  of  the  similarity  of  V  and  M  given  by 
(4.3.3)  aind  (4.4.2),  respectively. 


Condition  1 

The  levels  are  restricted  to  be  x=-l,0,l.   A  grid  method  identical 
to  the  one  described  in  Condition  1  of  Section  4.3  is  used.   The  proof 
of  Theorem  4.1  is  applicable,  and  so  optimal  designs  for  negative  3  or 
S  are  found  as  explained  for  Condition  1  of  Section  4.3.   These 
"restricted"   minimax  designs  are  presented  in  Table  4.7  along  with  the 
values  of  M,  for  N=l.   The  efficiencies  of  the  "restricted"  designs 
relative  to  the  designs  for  Condition  3  are  once  again  given.   In  this 
case,  M  is  a  multiple  of  1/N,  so  the  relative  efficiency  is  defined  to 
be  the  ratio  of  the  corresponding  values  of  M.   The  relative  efficien- 
cies are  once  again  larger  than  0.95  when  3  and  3   are  both  less  than 
or  equal  to  1,  indicating  that  these  designs  are  only  slightly  less 
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efficient  than  the  optimal  designs  found  at  the  end  of  the  present 
section  in  Table  4.9. 

Condition  2 


In  this  subsection  local  rainimax  designs  are  found  under  the 
assumption  that  the  true  quadratic  parameter  is  zero.   The  same  argu- 
ment for  symmetry  as  used  in  Condition  2  of  Section  4.2  can  be  applied 

2 
here.   Decreasing  \    reduces  the  numerator  of  (4.4.2)  and  increases 

the  denominator,  and  hence  decreases  M.   So  the  minimax  design  must  be 

a  symmetric  design,  implying  a   =0.   Then  from  (4.4.2), 

M    =    Y^     +     Y^      .  (4.4.3) 

11      22 

Also,  the  same  argument  used  in  Condition  2  of  Section  4.2  can  again  be 

applied  to  show  that  every  pair  in  the  optimal  design  must  be  of  the 

foirm  (-l,x.)  or  (x.,1),  some  x.,  and  hence  M  can  be  '^rritten 
11  1 


:4.4.4) 


f(x)      g(x)   ' 


where  f(x)  and  g(x)  are  defined  in  (4.2.15)  and  (4.2.16).   >7otice  that 
the  only  differences  between  (4.4.4)  and  (4.3.5)  are  the  coefficients 
2/3  and  2/5. 

The  oartial  derivative  of  M  with  respect  to  x .  is 

1 

3f(x)       3g(x) 


5m    _      3x.         3x. 

3x.    ~        ^   +  —        ,  (4.4.5) 

"■        f  (x)       g2(x) 


where   3f(x)/ox.   and   3a(x)/3x.   are  given  in  (4.2.19)  and  (4.2.20). 

—    1        '  —    1 
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Via  the  same  procedure  employed  in  Condition  2  of  Section  4.3,  the 
optimal  design  is  a  comparison  of  (-1,-x)  and  {x,l)  an  equal  number  of 
times ,  where  x  is  the  solution  to 

(2(l+x)^+4x)cosh  +  (d-x)  (l+x)^+(l-x^))6  sinh   =   0         (4.4.6) 

To  show  that  the  matrix  of  second  order  partial  derivatives  is 
positive  definite,  equations  (4. 3 .8) -  (4 . 3 .14)  can  be  repeated  for  the 
present  situation.  Everything  is  identical  except  that  a  multiple  of 
2/3  and  2/5  is  removed  from  the  places  where  they  appear.  The  eigen- 
value (a-b)  can  then  be  shown  to  be  equal  to  (4.3.11)  after  the  coef- 
ficients 2/3  and  2/5  are  removed  from  (4.3.11).   Likewise,  the  eigen- 

N 
value   (a-b)  +  ^      is  equal  to  (4.3.13)  after  the  coefficients  2/3  and 

2/5  are  removed  from  (4.3.13). 

An  APL  computer  program  solved  (4.4.6)  for  S  =0 ( .02) 1 , 2 (1) 5 ,  and 
simultaneously  evaluated  both  eigenvalues.   Both  eigenvalues  were  posi- 
tive in  all  cases,  and  so  the  designs  presented  are  at  least  locally 
minimax.   The  designs  are  presented  in  Table  4.8  along  with  the  value 
of  M.   Again,  Theorem  3.3  is  applicable,  and  so  the  optimal  design  for 
a  negative  value  of  S,  is  the  same  as  the  optimal  design  for  |3  | . 

Condition  3 

A  grid  method  identical  to  the  one  described  in  Condition  3  of 
Section  4.2  was  used.   The  minimax  designs  are  presented  in  Table  4.9. 
Theorem  4.1  is  again  applicable,  and  so  optimal  designs  for  negative 
values  of  S^  or  B^  can  be  found  in  the  manner  described  for  Condition  3 
of  Section  4.2. 


Table  4.7.   Minimax  designs  with  restriction  x=-l,0,l 
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0 

0 

1 

0 

2 

0 

3 

0 

4 

0 

5 

0 

5 

0 

7 

0 

8 

0 

9 

0 

1 

0 

2 

0 

3 

0 

0 

.1 

1 

.1 

2 

.1 

3 

.1 

4 

.1 

5 

.1 

6 

.1 

7 

.1 

8 

.1 

9 

.1 

1 

.1 

2 

.1 

3 

.1 

0 

.2 

1 

.2 

2 

.2 

3 

.2 

4 

.2 

5 

.2 

6 

.2 

7 

.2 

8 

.2 

9 

.2 

1 

.2 

2 

.2 

3 

.2 

0 

.3 

1 

.3 

2 

.3 

'-1,0 

^0,1 

^-1,1 

M 

Efficiency 

423 

.423 

.155 

7.464108 

.9517 

423 

.423 

.154 

7.491435 

.9518 

424 

.424 

.152 

7.573516 

.9521 

426 

.426 

.149 

7.710603 

.9526 

428 

.428 

.144 

7.902992 

.9533 

431 

.431 

.137 

8.150852 

.9543 

437 

.437 

.127 

8.453897 

.9555 

443 

.443 

.114 

8.810935 

.9572 

453 

.453 

.094 

9.219111 

.9596 

467 

.467 

.067 

9.672845 

.9633 

485 

.485 

.030 

10.161998 

.9691 

500 

.500 

0 

19.048782 

.9723 

500 

.500 

0 

44.270630 

.7547 

423 

.423 

.155 

7.479891 

.9518 

420 

.424 

.156 

7.507998 

.9518 

420 

.429 

.151 

7.591027 

.9521 

418 

.431 

.152 

7.728451 

.9526 

421 

.437 

.142 

7.921003 

.9535 

420 

.441 

.139 

8.170156 

.9544 

427 

.452 

.121 

8.475105 

.9556 

426 

.456 

.118 

8.833076 

.9573 

432 

.466 

.103 

9.244843 

.9596 

450 

.489 

.061 

9.700654 

.9633 

459 

.504 

.037 

10.192365 

.9691 

462 

.538 

0 

19.128830 

.9712 

455 

.545 

0 

44.485809 

.7527 

422 

.422 

.156 

7.527333 

.9521 

418 

.426 

.156 

7.556258 

.9521 

416 

.433 

.151 

7.638617 

.9526 

413 

.438 

.149 

7.778711 

.9531 

407 

.441 

.152 

7.974294 

.9540 

409 

.451 

.140 

8.225651 

.9551 

411 

.461 

.128 

8.534287 

.9563 

413 

.472 

.115 

3.898054 

.9581 

408 

.475 

.118 

9.321956 

.9597 

424 

.502 

.074 

9.779487 

.9639 

439 

.528 

.033 

10.281797 

.9693 

425 

.575 

0 

19.356262 

.9682 

411 

.589 

0 

45.092941 

.7473 

422 

.422 

.156 

7.606749 

.9528 

415 

.427 

.158 

7.636298 

.9528 

410 

.435 

.154 

7.720152 

.9533 
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Table   4.7   -    continued 
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^2 

^-1,0 

^0,1 

^-1,1 

M 

Efficiency 

.3 

.3 

.403 

.440 

.157 

7,863355 

.9539 

.4 

.3 

.396 

.446 

.158 

8.064491 

.9547 

,5 

.3 

.401 

.464 

.135 

8.319720 

.9561 

.6 

.3 

.397 

.472 

.131 

8.634922 

.9575 

.7 

.3 

.400 

.489 

.110 

9.008231 

.9591 

.8 

.3 

.393 

.493 

.113 

9.437747 

.9612 

.9 

.3 

.389 

.501 

.110 

9.930961 

.9629 

1 

.3 

.417 

.549 

.035 

10.432550 

.9695 

2 

.3 

.388 

.612 

0 

19.731598 

.9637 

3 

.3 

.368 

.632 

0 

46.113266 

.7385 

0 

.4 

.421 

.421 

.157 

7.718635 

.9536 

.1 

.4 

.412 

.428 

.161 

7.748528 

.9537 

.2 

.4 

.407 

.440 

.153 

7.835239 

.9543 

.3 

.4 

.395 

.444 

.161 

7.983413 

.9549 

.4 

.4 

.395 

.462 

.143 

8.186843 

.9562 

.5 

.4 

.382 

.463 

.155 

8.454483 

.9572 

.6 

.4 

.386 

.486 

.127 

8.777301 

.9589 

.7 

.4 

.370 

.482 

.148 

9.174763 

.9594 

.8 

.4 

.380 

.514 

.106 

9.603919 

.9629 

.9 

.4 

.386 

.540 

.074 

10.100954 

.9658 

1 

.4 

.378 

.545 

.077 

10.652193 

.9692 

2 

.4 

.353 

.647 

0 

20.271484 

.9570 

3 

.4 

.327 

.673 

0 

47.553284 

.7265 

0 

.5 

.421 

.421 

.159 

7.863725 

.9546 

.1 

.5 

.412 

.433 

.156 

7.894499 

.9548 

n 

.5 

.397 

.438 

.165 

7.985312 

.9554 

.3 

.5 

.387 

.448 

.165 

8.138353 

.9561 

.4 

.5 

.382 

.463 

.155 

8.348237 

.9578 

.5 

.5 

.372 

.474 

.154 

8.624695 

.9593 

.6 

.5 

.370 

.492 

.139 

8.960258 

.9611 

.7 

.5 

.369 

.514 

.117 

9.361121 

.9628 

.8 

.5 

.363 

.527 

.110 

9.822090 

.9650 

.9 

.5 

.365 

.553 

.082 

10.342136 

.9678 

1 

.5 

.367 

.578 

.056 

10.913309 

.9710 

2 

.5 

.320 

.680 

0 

20.969727 

.9485 

3 

.5 

.289 

.711 

0 

49.423553 

.7118 

0 

.6 

.420 

.420 

.161 

8.042955 

.9558 

.1 

.6 

.410 

.435 

.156 

8.075470 

.9560 

.  2 

.6 

.393 

.442 

.165 

8.170047 

.9567 

.3 

.6 

.379 

.451 

.169 

8.329222 

.9577 

.4 

.6 

.372 

.468 

.160 

8.547760 

.9597 

.5 

.6 

.369 

.491 

.140 

8.834993 

.9615 

Table  4.7  -  continued 
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^1 

^2 

^-1,0 

^0,1 

^-1,1 

M 

Efficiency 

.6 

.6 

.350 

.492 

.158 

9.192108 

.9630 

.7 

.6 

.349 

.517 

.135 

9.605767 

.9661 

.8 

.6 

.351 

.547 

.103 

10.093208 

.9673 

.9 

.6 

.339 

.555 

.106 

10.641331 

.9696 

1 

.6 

.342 

.589 

.069 

11.246311 

.9727 

2 

.6 

.289 

.712 

0 

21.845016 

.9380 

3 

.6 

.254 

.747 

0 

51.742035 

.6947 

0 

.7 

.419 

.419 

.162 

8.257525 

.9571 

.1 

.7 

.407 

.436 

.157 

8.291222 

.9573 

.2 

.7 

.387 

.443 

.170 

8.390544 

.9582 

.3 

.7 

.378 

.462 

.160 

8.553052 

.9601 

.4 

.7 

.366 

.477 

.157 

8.785346 

.9622 

.5 

.7 

.351 

.489 

.161 

9.088071 

.9640 

.6 

.7 

.344 

.509 

.147 

9.456905 

.9671 

.7 

.337 

.532 

.131 

9.898378 

.9687 

.8 

.7 

.331 

.554 

.115 

10.411327 

.9712 

.9 

.7 

.319 

.565 

.117 

10.997437 

.9722 

1 

.7 

.312 

.585 

.103 

11.652453 

.9735 

2 

.7 

.260 

.740 

0 

22.891083 

.9259 

3 

.7 

.221 

.779 

0 

54.549164 

.67  54 

0 

.8 

.418 

.418 

.164 

8.508865 

.9584 

.1 

.8 

.405 

.437 

.158 

8.545020 

.9586 

.2 

.8 

.385 

.448 

.168 

8.647012 

.9600 

.3 

.8 

.369 

.463 

.169 

8.821605 

.9617 

.4 

.8 

.359 

.485 

.156 

9.063863 

.9644 

.5 

.8 

.351 

.510 

.138 

9.386874 

.9667 

.6 

.8 

.335 

.523 

.142 

9.773139 

.9700 

.7 

.8 

.317 

.529 

.154 

10.245109 

.9724 

.8 

.8 

.315 

.564 

.121 

10.785250 

.9746 

.9 

.8 

.307 

.586 

.107 

11.406818 

.9761 

1 

.8 

.300 

.609 

.091 

12.101690 

.9770 

.8 

,233 

.767 

0 

24.133331 

.9118 

3 

.3 

.193 

.807 

0 

57.868576 

.6543 

0 

.9 

.417 

.417 

.165 

8.798699 

.9597 

.1 

.9 

.398 

.433 

.169 

8.835464 

.9601 

.2 

.9 

.384 

.454 

.162 

8.944130 

.9616 

.3 

.9 

.363 

.466 

.171 

9.128388 

.9638 

.4 

.9 

.350 

.489 

.162 

9.385105 

.9669 

.5 

.9 

.338 

.512 

.151 

9.721140 

.9702 

.5 

.9 

.315 

.517 

.168 

10.142849 

.9730 

.7 

.9 

.305 

.540 

.155 

10.635491 

.9766 

.8 

.9 

.298 

.569 

.133 

11.213647 

.9794 
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Table  4.7 

-  continued 

h 

^2 

^-1,0 

'^0,1 

^-1,1 

M 

Efficiency 

.9 

.9 

.288 

.591 

.122 

11.879495 

.9804 

1 

.9 

.295 

.649 

.056 

12.669651 

.9771 

2 

.9 

.209 

.791 

0 

25.575104 

.8960 

3 

.9 

.167 

.833 

0 

61.731598 

.6320 

0 

1 

.417 

.417 

.167 

9.129013 

.9609 

.1 

1 

.396 

.434 

.171 

9.167790 

.9615 

.2 

1 

.380 

.457 

.163 

9.283387 

.9632 

.3 

1 

.362 

.477 

.162 

9.476922 

.9658 

.4 

1 

.338 

.488 

.174 

9.753860 

.9690 

.5 

1 

.328 

.517 

.155 

10.107888 

.9732 

.6 

1 

.317 

.545 

.138 

10.556965 

.9766 

.7 

1 

.294 

.550 

.156 

11.080395 

.9810 

.8 

1 

.286 

.582 

.131 

11.701517 

.9840 

.9 

1 

.272 

.598 

.130 

12.414202 

.9855 

1 

1 

.263 

.625 

.112 

13.222181 

.9845 

2 

1 

.187 

.813 

0 

27.223267 

.8787 

3 

1 

.144 

.856 

0 

66.143311 

.6089 

0 

2 

.416 

.416 

.168 

15.363714 

.9469 

.1 

2 

.383 

.446 

.171 

15.441003 

.9468 

.2 

2 

.354 

.480 

.165 

15.671208 

.9466 

.3 

2 

.321 

.506 

.173 

16.059067 

.9471 

.4 

T 

.293 

.538 

.169 

16.609390 

.9488 

.5 

2 

.265 

.564 

.171 

17.330353 

.9525 

.6 

2 

.240 

.591 

.170 

18.233276 

.9587 

.7 

2 

.214 

.609 

.177 

19.333313 

.9675 

.8 

2 

.191 

.630 

.179 

20.642090 

.9720 

.9 

2 

.174 

.660 

.166 

22.173538 

.9561 

1 

2 

.154 

.672 

.174 

23.953873 

.9378 

2 

2 

.066 

.933 

0 

60.633728 

.6313 

3 

2 

.033 

.967 

0 

155.540634 

.3733 

0 

3 

.430 

.430 

.140 

31.329956 

.3058 

,1 

3 

.392 

.470 

.139 

31.497498 

.8051 

.2 

3 

.352 

.506 

.142 

31.999695 

.3033 

.3 

3 

.316 

.544 

.140 

32.844849 

.8004 

.4 

3 

.280 

.577 

.143 

34.046616 

.7967 

.5 

3 

.251 

.600 

.149 

35.632156 

.7920 

.6 

3 

.605 

0 

.395 

35.907074 

.8238 

.7 

3 

.581 

0 

.419 

35.822800 

.8704 

.3 

3 

.555 

0 

.445 

36.144714 

.9118 

.9 

3 

.528 

0 

.472 

36.891647 

.9447 

1 

3 

.500 

0 

.500 

118.097580 

.9682 

2 

3 

.231 

0 

.769 

95.645172 

.6100 

3 

3 

.010 

.990 

0 

409.475830 

.2012 

Table  4.8.   Minimax  (local)  designs  with  62=0 
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61 

Optimal  X 

M 

0 

-.2291 

7.103231 

.02 

-.2290 

7.104304 

.04 

-.2289 

7.107523 

.06 

-.2286 

7.112889 

.08 

-.2283 

7.120402 

.10 

-.2279 

7.130064 

.12 

-.2273 

7.141875 

.14 

-.2267 

7.155837 

.16 

-.2260 

7.171951 

.18 

-.2251 

7.190220 

.20 

-.2242 

7.210647 

.22 

-.2232 

7.233232 

.24 

-.2221 

7.257980 

.26 

-.2209 

7.284892 

.28 

-.2196 

7.313973 

.30 

-.2182 

7.345226 

.32 

-.2167 

7.378654 

.34 

-.2151 

7.414262 

.36 

-.2134 

7.452053 

.38 

-.2117 

7.492032 

.40 

-.2098 

7.534204 

.42 

-.2079 

7.578573 

.44 

-.2059 

7.625144 

.46 

-.2038 

7.673922 

.48 

-.2016 

7.724913 

.50 

-.1993 

7.778122 

.52 

-.1970 

7.833555 

.54 

-.1945 

7.891217 

61 

Optimal  X 

M 

.56 

-.1920 

7.951115 

.58 

-.1894 

8.013255 

.60 

-.1867 

8.077642 

.62 

-.1840 

8.144283 

.64 

-.1812 

8.213184 

.66 

-.1783 

8.284353 

.68 

-.1753 

8.357794 

.70 

-.1723 

8.433517 

.72 

-.1692 

8.511525 

.74 

-.1660 

8.591828 

.76 

-.1628 

8.674431 

.78 

-.1595 

8.759341 

.80 

-.1561 

8.846566 

.82 

-.1527 

8.936111 

.34 

-.1492 

9.027984 

.86 

-.1457 

9.122192 

.88 

-.1421 

9.218741 

.90 

-.1384 

9.317639 

.92 

-.1347 

9.418892 

.94 

-.1309 

9.522507 

.96 

-.1271 

9.628489 

.98 

-.1233 

9.736847 

1 

-.1193 

9.847587 

2 

.1066 

18.521632 

3 

.3087 

33.412753 

4 

.4510 

54.321313 

5 

.5487 

81.078453 
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Table  4.9.   Minimax  designs 


\ 

^2 

\ 

^2 

"-!,., 

S,i 

^-1,1 

M 

0 

0 

.23 

-.23 

.500 

.500 

0 

7.103233 

.1 

0 

.23 

-.23 

.500 

.500 

0 

7.130062 

.2 

0 

.22 

-.22 

.500 

.500 

0 

7.210647 

.3 

0 

.22 

-.22 

.500 

.500 

0 

7.345225 

.4 

0 

.21 

-.21 

.500 

.500 

0 

7.534202 

.5 

0 

.20 

-.20 

.500 

.500 

0 

7.778128 

.6 

0 

.19 

-.19 

.500 

.500 

0 

8.077641 

.7 

0 

.17 

-.17 

.500 

.500 

0 

8.433517 

.8 

0 

.16 

-.16 

.500 

.500 

0 

8.846562 

.9 

0 

.14 

-.14 

.500 

.500 

0 

9.317636 

1 

0 

.12 

-.12 

.500 

.500 

0 

9.847586 

2 

0 

-.11 

.11 

.500 

.500 

0 

18.521622 

3 

0 

-.31 

.31 

.500 

.500 

0 

33.412704 

0 

.1 

.23 

-.23 

.500 

.500 

0 

7.119185 

.1 

.1 

.23 

-.23 

.497 

.503 

0 

7.146172 

.2 

.1 

.22 

-.23 

.495 

.506 

0 

7.227188 

.3 

.1 

.22 

-.22 

.492 

.509 

0 

7.362472 

.4 

.1 

.21 

-.21 

.489 

.511 

0 

7.552416 

.5 

.1 

.20 

-.20 

.486 

.514 

0 

7.797619 

.6 

.1 

.19 

-.19 

.483 

.517 

0 

8.098640 

.7 

.1 

.17 

-.17 

.481 

.519 

0 

8.456331 

.8 

.1 

.16 

-.15 

.478 

.522 

0 

8.871431 

.9 

.1 

.15 

-.13 

.476 

.524 

0 

9.344682 

1 

.1 

.13 

-.11 

.474 

.526 

0 

9.877072 

2 

.1 

-.09 

.12 

.466 

.534 

0 

18.576996 

3 

.1 

-.29 

.33 

.467 

.533 

0 

33.484009 

0 

.2 

.23 

-.23 

.500 

.500 

0 

7.167143 

.1 

.2 

.23 

-.23 

.494 

.506 

0 

7.194577 

.2 

.2 

.22 

-.23 

.489 

.511 

0 

7.276844 

.3 

.2 

.22 

-.22 

.483 

.517 

0 

7.414238 

.4 

.2 

.21 

-.21 

.477 

.523 

0 

7.607140 

.5 

.2 

.20 

-.20 

.472 

.528 

0 

7.856112 

.6 

.2 

.19 

-.18 

.467 

.533 

0 

8.161740 

.7 

.2 

.18 

-.17 

.462 

.538 

0 

8.524799 

.8 

.2 

.16 

-.15 

.457 

.543 

0 

8.945994 

.9 

.2 

.15 

-.13 

.453 

.547 

0 

9.426017 

1 

.2 

.14 

-.10 

.449 

.551 

0 

9.965639 

2 

.2 

-.07 

.15 

.432 

.568 

0 

18.741409 

3 

.2 

-.27 

.35 

.434 

.566 

0 

33.697693 

0 

.3 

.23 

-.23 

.500 

.500 

0 

7.247409 

.1 

.3 

.23 

-.23 

.492 

.508 

0 

7.275542 

.2 

.3 

.23 

-.23 

.483 

.517 

0 

7.359927 
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Table  4, 

,9  -  continued 

\ 

^2 

\ 

^2 

"--. 

%.. 

^-1,1 

M 

,3 

.3 

,22 

-.22 

.474 

.526 

0 

7.500859 

.4 

.3 

.22 

-.21 

.465 

.535 

0 

7.699010 

.5 

.3 

.21 

-.19 

.457 

,543 

0 

7.954224 

.6 

.3 

.20 

-.18 

,450 

.550 

0 

8.267556 

.7 

.3 

.18 

-.17 

.443 

,557 

0 

8.639672 

.8 

.3 

.17 

-.15 

.436 

.564 

0 

9.071136 

.9 

.3 

.16 

-.12 

.430 

.570 

0 

9,562373 

1 

.3 

.14 

-.10 

.424 

.576 

0 

10.114105 

2 

.3 

-.04 

.17 

.399 

.601 

0 

19.015671 

3 

.3 

-.24 

.37 

.403 

.598 

0 

34.052536 

0 

.4 

.24 

-.24 

.500 

.500 

0 

7.360502 

.1 

.4 

.23 

-.24 

.489 

.511 

0 

7.389644 

.2 

.4 

.23 

-.23 

.477 

.523 

0 

7.477092 

.3 

.4 

.22 

-.23 

.467 

.533 

0 

7.623173 

.4 

.4 

.21 

-.22 

.456 

.544 

0 

7.828116 

,5 

.4 

.21 

-.20 

.445 

.555 

0 

8.092491 

.6 

.4 

.20 

-.18 

.434 

.566 

0 

8.416834 

.7 

.4 

.19 

-.16 

.424 

.576 

0 

8.802041 

.8 

.4 

.18 

-.14 

.415 

.585 

0 

9.247813 

.9 

.4 

.16 

-.12 

.407 

.593 

0 

9.755398 

1 

.4 

.15 

-.09 

.400 

.600 

0 

10.323983 

2 

.4 

-.02 

.19 

.367 

.633 

0 

19.398895 

3 

.4 

-.22 

.39 

.372 

.628 

0 

34.546707 

0 

.5 

.24 

-.24 

.498 

.498 

.004 

7.507002 

.1 

.5 

.24 

-.24 

.484 

.513 

.003 

7.537487 

.2 

.5 

.23 

-.24 

,472 

.527 

,001 

7.628940 

.3 

.5 

.23 

-.23 

,457 

.543 

0 

7.781449 

.4 

.5 

.22 

-.22 

.444 

.556 

0 

7.995684 

.5 

.5 

.20 

-.21 

.432 

.567 

.002 

8.273508 

.6 

.5 

.21 

-.18 

.417 

.581 

.001 

8.611589 

.7 

.5 

.20 

-.16 

.406 

.594 

0 

9.012951 

.8 

.5 

.19 

-.13 

.394 

.606 

0 

9.478048 

.9 

.5 

.19 

-.09 

.383 

.617 

0 

10.008749 

1 

.5 

.16 

-.08 

.376 

.624 

0 

10,597091 

2 

.5 

0 

.21 

.337 

.663 

0 

19,890823 

3 

.5 

-.20 

.40 

.342 

.658 

0 

35.178162 

0 

.6 

.24 

-.24 

.495 

.495 

.011 

7.687564 

.1 

.6 

.23 

-.23 

.475 

.509 

.016 

7.719963 

.2 

.6 

.23 

-.24 

.463 

.530 

.007 

7.816233 

.3 

.6 

.23 

-.23 

.449 

.549 

.002 

7.977216 

.4 

.6 

.23 

-.22 

.433 

.567 

0 

8.203011 

.5 

.6 

.22 

-.20 

.417 

.583 

0 

8.494607 

Table   4.9-   continued 
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Sl 

^2 

^1 

^2 

"-1.X, 

\,i 

^-1,1 

M 

.6 

.6 

.20 

-.20 

.404 

.596 

0 

8.851893 

.7 

6 

.22 

-.18 

.388 

.612 

0 

9.279871 

.8 

.6 

.19 

-.14 

.376 

.624 

0 

9.763409 

.9 

6 

.18 

-.11 

.364 

.636 

0 

10.318142 

1 

6 

.19 

-.09 

.353 

.647 

0 

10.939160 

2 

6 

.03 

.23 

.309 

.691 

0 

20.490387 

3 

6 

-.18 

.42 

.314 

.686 

0 

35.944672 

0 

7 

.24 

-.24 

.491 

.491 

.018 

7.903124 

.1 

7 

.24 

-.23 

.473 

.513 

.014 

7.937562 

.2 

7 

.24 

-.24 

.457 

.534 

.010 

8.039942 

.3 

7 

.22 

-.24 

.439 

.550 

.011 

3.211526 

.4 

7 

.25 

-.22 

.420 

.578 

.002 

8.452837 

.5 

7 

.22 

-.21 

.405 

.595 

0 

8.760774 

.6 

7 

.19 

-.19 

.383 

.600 

.017 

9.145382 

.7 

7 

.21 

-.17 

.372 

.628 

0 

9.588939 

.8 

7 

.18 

-.15 

.359 

.641 

.001 

10.111272 

.9 

7 

.20 

-.10 

.342 

.658 

0 

10.692100 

1 

7 

.19 

-.06 

.331 

.669 

0 

11.343455 

2 

7 

.06 

.26 

.283 

.717 

0 

21.195862 

3 

7 

-.15 

.44 

.288 

.712 

0 

36.841553 

0 

8 

.24 

-.24 

.488 

.488 

.024 

8.154837 

.1 

8 

.23 

-.24 

.468 

.508 

.024 

8.191410 

.2 

8 

.23 

-.24 

.447 

.532 

.021 

8.300882 

.3 

8 

.22 

-.24 

.427 

.553 

.020 

8.484043 

.4 

8 

.22 

-.23 

.408 

.576 

.016 

8.741317 

.5 

8 

.20 

-.23 

.391 

.596 

.013 

9.074366 

.6 

8 

.21 

-.19 

.371 

.621 

.008 

9.479525 

.7 

8 

.20 

-.16 

.350 

.633 

.017 

9.962827 

.8 

8 

.21 

-.13 

.338 

.662 

0 

10.511288 

.9 

8 

.20 

-.10 

.324 

.677 

0 

11.134350 

1 

8 

.21 

-.05 

.309 

.691 

0 

11.823655 

2 

8 

.08 

.28 

.259 

.741 

0 

22.005203 

3 

8 

-.13 

.45 

.264 

.736 

0 

37.865631 

0 

9 

.24 

-.24 

.486 

.486 

.029 

8.444048 

.1 

9 

.24 

-.24 

.461 

.508 

.031 

8.483164 

.2 

9 

.23 

-.24 

.439 

.532 

.029 

8.600701 

.3 

9 

.23 

-.23 

.413 

.554 

.033 

8.797866 

.4 

9 

.23 

-.23 

.395 

.582 

.024 

9.074232 

.5 

9 

.21 

-.21 

.373 

.602 

.025 

9.431239 

.6 

9 

.20 

-.19 

.353 

.624 

.023 

9.869430 

.7 

9 

.21 

-.17 

.337 

.653 

.011 

10.386945 

.8 

9 

.20 

-.12 

.315 

.667 

.018 

10.982839 
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Table  4, 

.9  -  continued 

h 

^2 

^1 

^2 

"-!,., 

%,i 

^-1,1 

M 

.9 

.9 

.22 

-.09 

.304 

.696 

0 

11.646238 

1 

.9 

.22 

-.04 

.289 

.711 

0 

12.379728 

2 

.9 

.12 

.30 

.238 

.762 

0 

22.915192 

3 

.9 

-.10 

.47 

.242 

.758 

0 

39.012115 

0 

1 

.25 

-.25 

.483 

.483 

.034 

8.772314 

.1 

1 

.24 

-.25 

.459 

.507 

.034 

8.814472 

.2 

1 

.24 

-.24 

.429 

.533 

.037 

8.941481 

.3 

1 

.22 

-.24 

.407 

.555 

.038 

9.152744 

.4 

1 

.21 

-.24 

.385 

.582 

.034 

9.451067 

.5 

1 

.20 

-.21 

.359 

.603 

.038 

9.836727 

.5 

1 

.20 

-.19 

.336 

.627 

.037 

10.310200 

.7 

1 

.19 

-.15 

.314 

.648 

.038 

10.870255 

.8 

1 

.21 

-.12 

.298 

.682 

.020 

11.514256 

.9 

1 

.21 

-.07 

.279 

.696 

.025 

12.233892 

1 

1 

.24 

-.03 

.270 

.730 

.001 

13.016977 

2 

1 

.15 

.33 

.218 

.782 

0 

23.921951 

3 

1 

-.07 

.49 

.222 

.778 

0 

40.275284 

0 

2 

.41 

-.41 

.500 

.500 

0 

14.548218 

.1 

2 

.34 

-.48 

.480 

.520 

0 

14.618847 

.2 

2 

.27 

-.53 

.458 

.542 

0 

14.834950 

.3 

2 

.21 

-.56 

.433 

.567 

0 

15.209146 

.4 

2 

.14 

-.60 

.407 

.593 

0 

15.759338 

,5 

2 

.08 

-.62 

.381 

.619 

0 

16.507782 

.6 

2 

.03 

-.63 

.352 

.648 

0 

17.479965 

.7 

2 

-.03 

-.64 

.326 

.674 

0 

18.704865 

.8 

2 

0 

.31 

.174 

.624 

.202 

20.063736 

.9 

2 

0 

.34 

.156 

.637 

.207 

21.200836 

1 

2 

-.02 

.37 

.144 

.642 

.213 

22.464966 

2 

2 

.47 

.53 

.126 

.874 

0 

38.277344 

3 

2 

.24 

.62 

.117 

.883 

0 

58.069946 

0 

3 

.57 

-.57 

.500 

.500 

0 

25.244232 

.1 

3 

.52 

-.61 

.477 

.523 

0 

25.358597 

.2 

3 

.46 

-.65 

.455 

.545 

0 

25.704498 

.3 

3 

.40 

-.68 

.434 

.566 

0 

26.289764 

.4 

3 

.32 

-.71 

.417 

.583 

0 

27.124908 

.5 

3 

.22 

-.74 

.405 

.595 

0 

28.220917 

.6 

3 

.10 

-.76 

.403 

.597 

0 

29.581024 

.7 

3 

-.10 

-.79 

.421 

.579 

0 

31.180283 

.8 

3 

-.13 

-.33 

.434 

.566 

0 

32.955276 

.9 

3 

-.14 

-.87 

.446 

.555 

0 

34.851456 

1 

3 

-.16 

-.91 

.456 

.544 

0 

36.885345 

2 

3 

.65 

.66 

.100 

.900 

0 

58.347656 

3 

3 

.47 

.71 

.089 

.911 

0 

82.387863 
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The  optimal  values  of  x  and  x   in  Table  4.9  are  once  again  simi- 
lar to  the  previous  two  optimality  criteria  discussed  in  the  present 
chapter.   However,  notice  that  the  pair  (-1,1)  should  seldom  or  never 
be  compared  for  the  minimax  criterion.   That  is  the  major  difference 
between  the  present  designs  and  the  designs  in  the  two  previous  sections. 
The  optimal  designs  for  3^=0  found  in  Table  4.9  are  identical  to  the 
designs  found  in  Table  4.8,  suggesting  that  the  minimax  designs  found 
in  Table  4.8  may  in  fact  give  absolute  minimums  for  M. 

4.5   Conclusion  and  Design  Recommendations 

Figure  4.3  is  a  graph  of  the  optimal  level  to  be  compared  with 
x=l  for  each  of  the  three  criteria  discussed  in  the  present  chapter 
when  6  =0,  as  a  function  of  | 8, | .   This  figure  has  been  referred  to  in 
Condition  2  for  each  of  the  three  previous  sections.   Recall  that  these 
are  only  locally  optimal  in  some  cases,  and  hence  are  possibly  not  as 
useful  as  the  optimal  designs  found  for  Condition  3  in  the  three  pre- 
vious sections.   However,  notice  that  the  optimal  value  of  x  is  closer 
to  0  for  the  minimax  criterion  than  it  is  for  the  other  two  criteria. 
Also,  the  slope  of  the  D-optimal  curve  is  steeper  than  the  other  two 
which  are  essentially  parallel,  signifying  that  these  D-optimal  designs 
change  faster  than  the  others  as  |S^|  changes. 

The  remainder  of  this  section  contains  a  discussion  and  comparison 
of  seven  particular  designs  on  how  good  they  are  overall.   Estimates 
of  their  relative  efficiencies  are  obtained  for  the  three  optimality 
criteria  discussed  in  the  present  chapter,  and  it  is  determined  which 
designs  are  best  overall  for  protecting  against  possible  bias. 
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Let  Designs  1-3  be  defined  as  three  point,  four  point,  and  five 
point  designs,  respectively,  where  the  levels  are  eqxaally  spaced,  and 
all  pairs  are  compared  an  equal  number  of  times.   Also,  define  Designs 
4-7  as: 

Design  4:  {\^_^^^^^   =  U__24,l  =  •^'  ^-1,1  =  "^^  ' 

Design  5:  ^y_,^_24  =   ^-.24,1  =  ■''^'    ^^-1,1  =  '^^    ' 

Design  6:  {u_^   2  "  ^-  2  1  ^  '^-^  ' 

Design  7:  {y_    5  "^  ^_  5  i  "^  .4706,  i^  ,  ,  =  .0588}  . 

The  reason  for  including  Designs  1-3  is  that  they  are  designs  which 
might  naively  be  run  by  an  experimenter  who  has  little  knowledge  of 
optimal  designs.   The  motivation  for  including  Designs  4  and  5  is  that 
they  are  similar  to  many  of  the  optimal  designs  found  in  Tables  4.3, 
4.6,  and  4.9,  especially  for  relatively  small  parameter  values.   Design 
6  is  similar  to  the  optimal  designs  for  large  parameter  values.   The 
source  of  Design  7  is  Springall's  paper.   It  is  included  here  although 
he  did  not  state  any  optimal  properties  for  the  design. 

The  efficiencies  of  the  seven  designs  defined  above  relative  to 
the  optimal  designs  found  in  Tables  4.3,  4.6,  and  4.9  were  calculated 
for  combinations  of  B  ,3  =0(.2)1.   The  integrated  mean  square  error  (J) 
was  calculated  for  3  ,S^=0(.25)1  and  B  =-l(.4)l,  where 

C        ■ 

J   =   I    E(ln  TT   -  g(x)  )   dx  , 
^-1 

N=100,  and  the  true  model,  g(x),  is  cubic.   Finally,  the  bias  part  of  J 
was  calculated.   See  the  following  chapter  for  an  expression  for  J  and 
the  bias. 
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Table  4.10  presents  the  minimum,  maximum,  and  median  of  the  rela- 
tive efficiencies  for  each  of  the  three  criteria  discussed  in  the  pres- 
ent chapter.   This  table  gives  an  overall  estimate  of  what  is  lost  by 
running  a  design  different  from  the  optimal  design.   The  estimates  are 
given  for  the  24  combinations  of  Q      and  Q     where  j 3, |  ^  .6/  for  the  12 
where  [  S^  |  >  .5,  and  for  all  36  combined.   Remember  that  these  minimvims , 
maximiims ,  and  medians  are  only  estimates  of  what  could  be  considered  as 
corresponding  tr^ae  parameter  values. 

The  efficiencies  for  the  D-optimal  criterion  will  now  be  discussed. 
The  average-variance  and  minimax  criteria  can  be  considered  in  a  simi- 
lar manner.   For  the  condition  j3  |  ^1,  Designs  4  and  5  both  have  a 
median  over  99%,  with  Design  4  slightly  larger.   However  Design  5  has 
a  minimum  efficiency  of  96.5%  as  opposed  to  93.5%  for  Design  4.   Both 
of  these  designs  are  overall  superior  to  the  other  designs  considered. 
For  the  case  |S  j  £  .6,  Designs  4  and  5  are  again  superior  to  the 
others.   However,  Design  6  is  the  better  design  for  the  case  [ S^ |  >  .6, 
although  Design  5  is  very  close. 

The  values  of  the  bias  and  the  integrated  mean  square  error  were 
ranked  from  smallest  (1)  to  largest  (7)  for  each  of  the  150  combinations 
of  8  ,  S  ,  and  B      considered.   Table  4.11  presents  an  arithmetic  mean 
of  these  ranks.   This  gives  a  rough  idea  of  how  the  bias  and  integrated 
mean  square  error  compare  among  the  seven  designs. 

It  is  no  surprise  that  Design  3  has  a  small  bias  since  there  are  a 
total  of  ten  pairs  compared  an  equal  number  of  times.   Surprisingly, 
Design  7  had  the  smallest  bias  every  time.   However,  the  variance  part 
of  J  is  much  larger  for  Designs  3  and  7  than  for  Designs  5  and  6,  and 


132 

hence  the  latter  two  designs  have  smaller  values  of  J  as  indicated  by 
the  average  rankings  in  Table  4.11. 

By  taking  in  conjionction  the  information  given  by  Tables  4.10  and 
4.11,  the  following  recommendations  are  given.   If  no  a  priori  informa- 
tion about  S,  is  available,  or  if  it  is  believed  that  | 6, |  ^  .6,  then 
Design  5  is  a  good  design  to  use.   If  it  is  believed  that  | 6, |  >  .5, 
then  Design  6  is  the  better  design. 

The  relative  efficiencies  were  also  calculated  for  the  design 
(y      c"^   i;n~^n  c   ~  ^    ^    ^    ~    -25}.   They  were  in  the  vicinity  of 

25%  efficient.   Hence  this  design  and  Designs  1-3,  any  of  which  an 
experimenter  could  naively  elect  to  use,  are  in  fact  poor  designs  for 
fitting  a  quadratic  model. 


Table  4.10.   Efficiency  of  designs 
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Design  Condition 


16,1 

|6J 

IBJ 

|6J 

ISJ 

lej 

IBJ 

ISJ 

IBJ 

IBJ 

16,1 

|6.  1 

13,1 

16,1 

16,1 

|B,I 

16,1 

16,! 

16,1 

IB,! 

16,1 

Minimum 
D     V     M 


S  .6  .954  .934  .829 

>  .5  .918  .914  .770 
^  1  .918  .914  .770 

^  .6  .736  .723  .648 

>  .6  .727  .724  .616 
^  1  .727  .723  .616 

<.  .6  .616  .604  .548 

>  .6  .623  .615  .532 
^  1  .616  .604  .532 

^  .6  .988  .963  .795 

>  .6  .935  .921  .694 
<.  1  .935  .921  .694 

<.  .6  .970  .986  .796 

>  .6  .966  .947  .692 
<,  1  .966  ,947  .692 


^  .6  .905 
>  .6  .974 
^  1    .905 


.945 
,936 
.936 


.772 
,683 
,683 


Relative  Efficiency 

Maximum 

D  V  M 

.968  .964  .897 

.965  .970  .880 

.968  .970  .897 

.763  .765  .722 

.773  .778  .689 

.773  .778  .722 

.650  .649  .608 

.668  .672  .582 

.668  .672  .608 

1  .989  .953 

.992  .966  .889 

1  .989  .953 


Median 

D     V  M 

.963  .940  .871 

.942  .933  .809 

.962  .940  .860 

.744  .733  .683 

.743  .738  .651 

.744  .733  .669 

.626  .615  .571 

.636  .630  .543 

.629  .620  .564 

.998  .980  .899 

.967  .942  .763 

.996  .975  .865 


^  .6  .891  .798  .645 
>  .6  .798  .717  .530 
^  1    .798   .717   .530 


1 

1 

.993 

.994 

.998 

.936 

998 

.981 

.943 

.988 

.967 

.790 

1 

1 

.993 

.991 

.993 

.910 

993 

.993 

1 

.958 

.972 

.947 

999 

.999 

.995 

.997 

.984 

.813 

999 

.999 

1 

.972 

.974 

.917 

961 

.891 

.828 

.931 

.840 

.746 

907 

.797 

.677 

.853 

.754 

.591 

961 

.891 

.828 

.920 

.825 

.702 

Table  4.11.   Bias  of  designs 


1.     _--  — 'V33%  ^  ^-3l%VL~ — -- 


I ^■ 


____.,  40%  ~^^^ 


^-"1.^40%  ""' 


20? 


.^I 1 1^ 1 


__,^  50<^,  -^^^ 


50% 

___,  5.88%  -____ 

,--'-'"''  ___-  47.06%  -~"l^""~-~„ 

I \ '-H ^ Ilr 1 

-1  ^^^^     -.5  ^^,  .5  1 

""■"■-  47.06%  ''''' 
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Mean  ranking 
Desian  Bias      J 


7.00     6.00 


2.  -1  -^/^  ^/^  ^      5.94     5.59 

Each  of  5  pairs  compared  an  equal  number  of  times 


I 1 1 \ 1 

-1  -.5  0  .5  1 

3.  2.41     5.97 

Each  of  10  pairs  compared  an  equal  number  of  times 


^-  -1   .  -.24  .24  1       ^-^^     ^•'^^ 


5-  -1   ,^  -.24      ^^  .24  1       3.85     2.18 

"""'-  10%  '" 


6.  ,       2.74     1.65 

-1  -.2        .2  1 


1.00     3.19 


CHAPTER  5 
DESIGNS  THAT  PROTECT  AGAINST  BIAS 

5 . 1   Introduction 

This  chapter  is  concerned  with  finding  designs  which  protect 
against  the  bias  present  when  the  true  model  is  cubic,  and  a  quadratic 
model  is  fit.   Section  5.2  contains  a  discussion  of  designs  which  mini- 
mize the  bias.   Section  5.3  presents  designs  which  minimize  J,  the 
integrated  mean  square  error,  where 


2 
E(ln  7T   -  g(x)  )   dx 

'^1 


2  "  2 

E(  In  TT   -  E(ln  TT  )  )   dx   +      (E(ln  tt  )  -  g(x))   dx 


and  where 


-1  ^-1 


V  +   B  ,  (5.1.1) 


g(x)    =    3*x  +  3*x^  +  3*x^  ,  (5.1.2) 


In  TT 

X 


3^x  +  62^   ,  (5.1.3) 


2 
In  TT^   =    3^x  +  S^x   .  (5.1.4) 
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In  the  present  chapter,  Bw  6^/  and  Q*  represent  the  true  parame- 
ter values.  Notice  that  designs  which  minimize  V  in  (5.1.1)  when  S*=0 
were  found  in  Section  4.3.   Since  6*=0  implies  B=0 ,  these  designs  also 


minimize  J.   An  expression  for  V  is  given  by  (4.3.3).   However  the  X. 


i: 


in  the  expression  are  now  a  f\inction  of  Q* ,    6*,  and  6*  rather  than  6, 
and  3_.   A  general  expression  for  \..    is  found  in  (2.3.10). 


5.2  All  Bias  Designs 
From  (5.1.2)  and  (5.1.3)  , 


(E(ln  7T  )  -  g(x)  ) 


=   (  (6^  -  B*)x  +  (62  -  8*)x^  -  8*x-^  ) 


B*)^x^  +  2(3^ 


i*) (S^  -  S*)x" 


+  (  (62  -  S*)^  -  2Q*{B^  -   8*)  )x'* 


-  ^^3(^2 


r,j.>  5    ,oj.2  5 
B*)x  +  3*  X 


(5.2.1) 


Then  from  (5.1.1)  and  (5.2.1),  the  bias  is 

3  =  r^ 


(E(ln  TT  )  -  g(x))   dx 

X 


-1 


2    2 


2,^2    4, 


=  f(3,  -3*)  .3(32-82*)  -73*  -  36*(3,  -3*)  . 


(5.2.2) 


Notice  that  any  design  which  results  with  the  values  of  3^  and  82 
that  minimizes  (5.2.2)  is  a  minimum  bias  design.   The  optimal  values  of 
3   and  3  as  functions  of  3*,  3*,  and  3*  are  now  found.   Taking  deriva- 


tives in  (5.2.2), 
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If-   -   f<6,  -  6J.  -  !«•  , 


1 


1^   =   |-(3.  -  S*) 


(5.2.3) 

5'''2    "^2' 


Setting  the  expressions  in  (5.2.3)  equal  to  zero  results  in 

(5.2.4) 
h        =        ^2      • 

The  three  roots  to  the  equation  formed  by  equating  (5.1.2)  and  (5.1.4), 
after  substituting  (5.2.4)  into  (5.1.4),  are  x=-. 7746 ,0, .7746.   These 
three  roots  are  the  points  at  which  the  quadratic  and  cubic  curves 
intersect. 

The  expected  number  of  times  that  x.  is  preferred  over  x.  is 

defined  as  n. .P(x.  ^  x.),  where  the  probability  that  x.  is  preferred 

13    1    3  ^ 

over  x   is  calculated  using  the  true  cubic  model.   This  is  referred  to 

J 

as  "expected"  data.   If  the  only  levels  compared  are  -.7746,  0,  and 
.7746,  then  the  "expected"  data  under  the  true  cubic  model  is  the  same 
as  the  "expected"  data  under  the  quadratic  model  given  by  (5.2.4). 
Hence  the  maximum  likelihood  procedure  using  "expected"  data  under  the 
true  model  results  in  3   and  3  when  only  the  three  levels  -.7746,  0, 
and  .7746  are  pairwise  compared.   This  procedure  is  equivalent  to  first 
finding  maximum  likelihood  estimates,  3,  and  Q    ,    from  the  data,  and 
then  taking  expectations.   This  was  verified  for  the  present  situation. 

Therefore,  any  paired  comparisons  among  the  levels  x=-. 7746 , 0, . 7746 
results  in  e3  =3   and  e3  =3-/  where  3,  and  3      are  given  in  (5.2.4),  and 
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hence  any  such  design  minimizes  the  bias.   Notice  that  the  optimal 
design  does  not  depend  on  the  parameters. 

This  choice  of  equally  optimal  designs  does  not  appear  to  be  rea- 
sonable, and  so  the  designs  are  not  recommended  to  be  used  in  practice. 
Minimizing  the  bias  could  result  in  a  large  average  variance,  and  hence 
a  large  integrated  mean  square  error,  J.   The  next  section  is  a  consid- 
eration of  designs  which  minimize  J. 

5.3   Integrated  Mean  Square  Error  Designs 
Define  the  function  f  as 

f(SwB^,B,,x)   =  In  TT   =   8,x  +  6^x^  +  6,x^  .        (5.3.1) 
12   3  X      12       3 

Then  it  is  clear  that 


f(6^,S2/33/x)   =   -f(-6^,-32/-63,x) 


-f{8^,-62.33,-x)  (5.3.2) 


f(-B^,B2'-63/-x)  , 


and 


f(8^,B2/-63,x)   =   -f(-6^, -62/83, X) 


-f(B^,-S2/-S3,-x)  (5.3.3) 


f(-B^,32'B3,-x)  . 


Intuitively,  this  would  imply  that  optimal  designs  only  need  to  be 
found  for  3^  0  and  6^  ^  0  since  f  is  just  transposed  about  the  x-axis 
or  y-axis ,  or  both,  for  the  case  of  negative  values  of  3  or  3^-   For 
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example,  by  (5.3.2)  the  function  f  for  (B^^-B^/B^)  if  f (B^,B2/33,x) 
transposed  at)Out  both  the  x-axis  and  y-axis.   From  (3.2.5),  (|)^^  can  be 
written 


exp(f(63_, 62^33, X.)  +  f(B^, 32^63, X. 


ID 


(  exp(f(3^, 62/63, X.))  +  exp(f(B^, 62,63, X.))  ) 


.  (5.3.4) 


The  fact  that  only  B^  0  and  62  ^  0  need  to  be  considered  can  be  veri- 
fied by  using  (5.3.4)  in  a  manner  similar  to  the  proof  of  Theorem  4.1. 

A  Fortran  program  performed  a  grid  search  for  the  designs  which 
minimize  J,  where  J  is  given  by  (5.1.1).   The  total  number  of  compari- 
sons was  taken  to  be  N=100,  and  so  V,  as  given  by  (4.3.3),  was  divided 
by  100  before  substituting  into  (5.1.1).   The  grid  search  was  performed 
for  combinations  of  8^,62=0 ,. 5 , 1 ,  and  S3=-l(.5)l,  plus  a  few  additional 
parameter  combinations.   The  levels  were  fixed  at  x=-l, -. 5 ,0 , . 5 ,1 .   The 
grid  allowed  for  all  10  possible  paired  comparisons.   The  search  ended 
when  all  10  comparison  proportions  were  accurate  to  at  least  ±.01. 

These  optimal  designs  are  presented  in  Table  5.1.   The  value  of  J 

is  also  given.   As  was  previously  discussed,  the  designs  for  negative 

B  or  B  are  found  as  follows.   First  of  all,  the  design  for  |B^|, 

IB  I,  and  6   is  located  in  the  table.   If  6   and  B-  are  both  positive 
2         3  L  ^ 

or  both  negative,  then  the  design  is  found  directly  from  Table  5.1.   If 
this  is  not  the  case,  then  n      becomes  n_   _   for  all  pairs  m  the 

X  .  /  X  .  X  .  /  X  . 

design. 

Notice  that  the  pairs  (-l,-.5),  (-.5,0),  and  (0,.5)  are  never  com- 
pared, and  (.5,1)  is  only  compared  when  3^=32=6^=1.   The  designs  pre- 
sented are  not  intended  to  be  precise,  but  rather  they  give  a  rough 
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description  of  designs  which  protect  against  bias.   For  example,  the 
designs  should  be  symmetric  when  6-=0,  but  Table  5.1  shows  them  to  be 
close  to  but  not  exactly  symmetric. 

Because  of  the  restriction  of  the  five  fixed  levels,  the  minimvmi 
value  of  J  found  in  the  present  section  is  not  necessarily  the  minimum 
for  the  class  of  all  possible  designs.   In  fact,  when  8  =0,  Designs  4-6 
in  Section  4.5  have  slightly  smaller  values  of  J  than  those  given  in 
Table  5.1.   This  can  be  seen  in  Table  5.2  which  compares  the  values  of 
J  for  the  optimal  designs  presently  being  discussed  with  Designs  4-6. 
This  table  shows  that  if  the  cubic  parameter  is  relatively  large,  then 
the  present  designs  are  significantly  better  for  protection  against 
bias.   Otherwise  Designs  4-6  adequately  protect  against  bias,  and  they 
additionally  are  highly  efficient  for  the  optimal  properties  discussed 
in  Chapter  4. 
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Table  5.1.   J-criterion  desiqns 


81 

82 

83 

^-1,0 

^,1 

^-1,.5 

^-.5,1^- 

.5,  .5 

'"-1,1 

^5,l 

* 

J 

0 

0 

-1 

.13 

.12 

.26 

.26 

.24 

0 

0 

.1128 

0 

0 

-.5 

.11 

.11 

.39 

.39 

0 

0 

0 

.0574 

0 

0 

0 

.39 

.37 

0 

.01 

0 

.23 

0 

.0366 

0 

0 

.5 

.11 

.11 

.39 

.39 

0 

0 

0 

.0574 

0 

0 

1 

.13 

.12 

.26 

.26 

.24 

0 

0 

.1128 

0 

.5 

-1 

.19 

.15 

.21 

.17 

.29 

0 

0 

.1146 

0 

.5 

-.5 

.07 

.14 

.44 

.35 

0 

0 

0 

.0590 

0 

.5 

0 

.39 

.36 

.01 

.03 

0 

.22 

0 

.0383 

0 

.5 

.5 

.14 

.07 

.35 

.44 

0 

0 

0 

.0590 

0 

.5 

1 

.15 

.19 

.17 

.21 

.29 

0 

0 

.1146 

0 

1 

-1 

.09 

.09 

.41 

.25 

.16 

0 

0 

.1212 

0 

1 

-.5 

.03 

.14 

.49 

.33 

0 

0 

0 

.0641 

0 

1 

0 

,38 

.36 

.01 

.02 

0 

.23 

0 

.0439 

0 

1 

.5 

.14 

.03 

.33 

.49 

0 

0 

0 

.0641 

0 

1 

1 

.09 

.09 

.25 

.41 

.16 

0 

0 

.1212 

.5 

0 

-1 

.05 

.05 

.37 

.36 

.17 

0 

0 

.1020 

.5 

0 

-.5 

.10 

.11 

.40 

.39 

0 

0 

0 

.0547 

.5 

0 

0 

.39 

.38 

.01 

.01 

0 

.22 

0 

.0405 

.5 

0 

.5 

.17 

.17 

.33 

.33 

0 

0 

0 

.0706 

.5 

0 

1 

.30 

.29 

.01 

.01 

.39 

0 

0 

.1310 

.5 

.5 

-1 

0 

.02 

.46 

.42 

.10 

0 

0 

.1034 

.  5 

.5 

-.5 

.08 

.12 

.41 

.39 

0 

0 

0 

.0563 

.  5 

.5 

0 

.38 

.39 

0 

.01 

0 

.23 

0 

.0424 

.5 

.5 

.5 

.18 

.14 

.28 

.41 

0 

0 

0 

.0728 

.5 

.5 

1 

.24 

.36 

.01 

.01 

.39 

0 

0 

.1342 

*   N=100,  true  model  cubic 
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Table  5.1  -  continued 


«1 

^2 

^3 

^-1,0 

^0,1 

^-1,.5 

^-.5,1  '^- 

.5, .5 

^-1,1 

^5,1 

J 

.5 

1 

-1 

0 

.03 

.47 

.39 

.11 

0 

0 

.1079 

.5 

1 

-.5 

.04 

.13 

.44 

.40 

0 

0 

0 

.0611 

.5 

1 

0 

.39 

.29 

0 

.11 

0 

.21 

0 

.0484 

.5 

1 

.5 

.20 

.06 

.23 

.52 

0 

0 

0 

.0795 

.5 

1 

1 

.18 

.43 

.06 

0 

.34 

0 

0 

.1439 

1 

0 

-1 

.08 

.08 

.32 

.32 

.20 

0 

0 

.1021 

1 

0 

-.5 

.15 

.16 

.35 

.34 

0 

0 

0 

.0615 

1 

0 

0 

.36 

.43 

.09 

.02 

0 

.11 

0 

.0528 

1 

0 

.5 

.33 

.34 

.06 

.03 

.24 

0 

0 

.0955 

1 

0 

1 

.31 

.31 

0 

0 

.38 

0 

0 

.1613 

1 

.5 

-1 

.06 

.08 

.34 

.34 

.18 

0 

0 

.1036 

1 

.5 

-.5 

.13 

.18 

.34 

.35 

0 

0 

0 

.0634 

1 

.5 

0 

.18 

.54 

.28 

0 

0 

0 

0 

.0548 

1 

.5 

.5 

.22 

.43 

.16 

.01 

.19 

0 

0 

.0986 

1 

.5 

1 

.26 

.38 

0 

0 

.37 

0 

0 

.1657 

1 

1 

-1 

0 

.03 

.42 

.46 

.09 

0 

0 

.1082 

1 

1 

-.5 

.11 

.20 

.33 

.37 

0 

0 

0 

.0694 

1 

1 

0 

.13 

.59 

.28 

0 

0 

0 

0 

.0631 

1 

1 

.5 

.20 

.48 

.13 

0 

.19 

0 

0 

.1085 

1 

1 

1 

.22 

.27 

0 

0 

.38 

0 

.13 

.1786 

.4 

.4 

-1 

.09 

.09 

.32 

.29 

.22 

0 

0 

.1043 

.4 

.6 

.2 

.29 

.13 

.19 

.40 

0 

0 

0 

.0480 

.8 

.6 

-1 

.04 

.05 

.38 

.38 

.16 

0 

0 

.1028 

*   N=100,  true  model  cubic 


143 


Table  5.2.   Values  of  J 


Design  4    Design  5    Design  6   "Minimum"  J 


0 

0 

-1 

.1433 

.1327 

.1299 

.1128 

0 

0 

-.5 

.0638 

.0601 

.0592 

.0574 

0 

0 

0 

.0357 

.0350 

.0359 

.0366 

0 

0 

.5 

.0638 

.0601 

.0592 

.0574 

0 

0 

1 

.1433 

.1327 

.1299 

.1128 

0 

.5 

-1 

.1470 

.1361 

.1332 

.1146 

0 

.5 

-.5 

.0659 

.0622 

.0616 

.0590 

0 

.5 

0 

.0374 

.0367 

.0380 

.0383 

0 

.5 

.5 

.0659 

.0622 

.0616 

.0590 

0 

.5 

1 

.1470 

.1361 

.1332 

.1146 

0 

1 

-1 

.1582 

.1467 

.1438 

.1212 

0 

1 

-.  5 

.0725 

.0690 

.0693 

.0641 

0 

1 

0 

.0428 

.0424 

.0448 

.0439 

0 

1 

.5 

.0725 

.0690 

.0693 

.0641 

0 

1 

1 

.1582 

.1467 

.1438 

.1212 

.5 

0 

-1 

.1374 

.1259 

.1215 

.1020 

.5 

0 

- .  5 

.0612 

.0576 

.0570 

.0547 

.5 

0 

0 

.0400 

.0390 

.0392 

.0405 

.5 

0 

.5 

.0754 

.0709 

.0690 

.0706 

.5 

0 

1 

.1626 

.1516 

.1486 

.1310 

.5 

.5 

-1 

.1402 

.1284 

.1238 

.1034 

.5 

.5 

-.5 

.0631 

.0596 

.0591 

.0563 

.5 

.5 

0 

.0419 

.0410 

.0417 

.0424 

.5 

.5 

.5 

.0784 

.0741 

.0725 

.0728 

.5 

.5 

1 

.1683 

.1572 

.1541 

.1342 

Note:   Designs  4-6  defined  in  Section  4.5,  N=100,  true  model  cubic 
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Table  5 . 2 


continued 


Design  4    Design  5    Design  6   "Minimum"  J 


5 

1 

-1 

.1489 

.1364 

.1312 

.1079 

5 

1 

-.5 

.0692 

.0657 

.0660 

.0611 

5 

1 

0 

.0479 

.0476 

.0498 

.0484 

5 

1 

.5 

.0876 

.0840 

.0839 

.0795 

5 

1 

1 

.1858 

.1745 

.1718 

.1439 

1 

0 

-1 

.1377 

.1257 

.1203 

.1021 

1 

0 

-.5 

.0661 

.0625 

.0614 

.0615 

1 

0 

0 

.0547 

.0523 

.0504 

.0528 

1 

0 

.5 

.1015 

.0948 

.0899 

.0955 

1 

0 

1 

.2060 

.1919 

.1846 

.1613 

1 

.5 

-1 

.1404 

.1281 

.1225 

.1036 

1 

.5 

-.5 

.0683 

.0648 

.0641 

.0634 

1 

.5 

0 

.0576 

.0556 

.0542 

.0548 

1 

.5 

.5 

.1069 

.1005 

.0959 

.0986 

1 

.5 

1 

.2162 

.2019 

.1943 

.1657 

1 

-1 

.1486 

.1357 

.1294 

.1082 

1 

-.5 

.0752 

.0721 

.0726 

.0694 

1 

0 

.0664 

.0658 

.0666 

.0631 

1 

.5 

.1232 

.1182 

.1152 

.1085 

1 

1 

.2477 

.2333 

.2257 

.1786 

Note:   Designs  4-6  defined  in  Section  4.5,  N=100,  true  model  cubic 


CHAPTER  6 
DESIGNS  FOR  PRELIMINARY  TEST  ESTIMATORS 

6.1   Introduction 

The  motivation  for  this  chapter  is  a  paper  by  Sen  (1979)  on  pre- 
liminary test  maximijin  likelihood  estimators  (PTMLE)  .   The  procedure  for 
the  PTMLE  is  to  collect  the  entire  data  and  then  make  a  test  of  hypoth- 
esis.  If  the  null  hypothesis  is  rejected,  then  the  maximum  likelihood 
estimates  under  an  unrestricted  parameter  space  are  found.   If  the  null 
hypothesis  is  accepted,  the  estimates  are  found  under  a  restricted  pa- 
rameter space. 

Presently,  the  unrestricted  parameter  space  is  the  two-dimensional 

(6  ,B  ) ,  the  restricted  parameter  space  is  (6  ,0) ,  and  hence  the  null 

hypothesis  is  H  :   3^=0.   The  objective  of  the  present  chapter  is  to 
o    2 

find  designs  which  minimize  the  integrated  mean  square  error  using  the 
preliminary  test  estimator.   This  is  similar  to  Section  4.3,  except 
that  in  the  present  situation  a  linear  model  may  be  fit  to  the  data 
instead  of  simply  fitting  a  quadratic  model  regardless  of  the  data. 

Define  (S^/0)  as  the  maximxim  likelihood  estimator  under  the  re- 
stricted parameter  space,  {Q    ,B   )    as  the  estimator  under  the  unre- 
stricted parameter  space,  and  (6*/ 3*)  as  the  PTMLE.   Sen  shows  that  for 
any  fixed  alternative,  i.e.  for  any  $7^0,       i^N(S   -  3^,6   -  8^)   and 
/N(6*  -  3,/3*  -  B^)   have  the  same  asymptotic  multi-normal  distribu- 
tion, and  therefore  the  optimal  designs  for  the  PTMLE  are  the  same  as 
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the  optimal  designs  found  in  Section  4.3.   Likewise,  the  optimal 
designs  for  6^=0  are  identical  to  the  ones  presented  in  Section  3.2. 

The  remaining  situation  is  when  (6  ,Q    )    is  "close"  to  the  re- 
stricted parameter  space,  i.e.  when  6_  is  "close"  to  zero.   This  is 

r   -1°° 

conceived  by  defining  a  sequence  (K  ;    of  local  alternatives  to  be 

^  N=l 


=  Y//N  , 


:6.1.1) 


where  Y  is  some  scalar  constant.   Notice  that  as  N-><»,  K  -*■  H  .   This 
situation  is  covered  in  the  next  section. 


6.2  Average-variance  Designs  for  Preliminary 
Test  Maximum  Likelihood  Estimators 


For  the  remainder  of  the  present  chapter,  the  sequence  of  alter- 
natives given  in  (6.1.1)  is  considered.   The  asymptotic  dispersion 
matrix  for  the  PTMLE  in  general  is  given  by  (5.8)  on  page  1029  of  Sen's 
paper.   After  working  through  Sen's  paper  to  find  this  matrix  for  the 
present  situation,  the  asymptotic  dispersion  matrix  for 
/N(3*  -  3^,S*  -  3^)  is 


E  = 


11 


12 


22 


1/X 


11 


11 


12 


-1 


12 


22 


,2      2   , 


^  rr'(  2P(x3,^^xJ,^)  -^^xl^^xi^)  ) 


where  ,\   ,  X      ,    and  \        are  given  by  (3 . 3 . 2)  -  (3  .  3 .4)  ,  x"  a  is  a  non- 

central  chi-square  random  variable  with  noncentrality  parameter  A  and 

9  2         2 

r  degrees  of  freedom,  xT    is  such  that   P(xr  r  /->  ■*  XT  ,  )  =  <^»  ^"<^ 
l,a  1,A=0    1,0L 
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2 

_  A,, A "•  A  _ 

2   11  22  12  /c  -,  ON 

Y  i >  (6.2.2) 

\l 


-\2/\l 


[6.2.3) 


Notice  that  in  (6.2.1)  noncentral  chi-square  probabilities  need  to 
be  found.   A  number  of  convenient  approximations  exist.   One  such 
approximation  is  to  use  a  central  chi-square  probability  to  approximate 
a  noncentral  chi-square  probability.   This  is  found  in  the  Handbook  of 
Mathematical  Functions,  published  by  the  National  Bureau  of  Standards. 
Letting  V  denote  the  degrees  of  freedom  and  A  denote  the  noncentrality 

1  9 

parameter,  P(X   .  ^  c)  can  be  approximated  by  P(X"'*  „  ^  c/{l+b)),  where 
\)  fix  V  ,  0 

b  =  A/(v  +  A)  ,  and  V*  =  (V  +  A)/(l  +  b)  . 

Haynam,  Govindarajulu,  and  Leone  (1962)  present  a  computational 
formula  for  noncentral  chi-square  probabilities.   The  formula  is 


^      j! 


P(X^_,>y)  -  \'  -"''-'-'V^)^ 


j=0 


r((v/2)+j) J 
y 


(x/2)^^/2).j-l^-x/2^^^/2^ 


-Y 


''"'''"^^''  P(X,^     >y)   .  (6.2.4, 


j!         ■^V 
j=0  2  ^  ^ 


The  value  of  j!  becomes  large  very  rapidly,  and  hence  the  summation  in 
(6.2.4)  also  converges  rapidly. 

These  two  methods  were  compared  to  observe  how  close  the  approxi- 
mation is  to  the  actual  probability,  since  the  computing  costs  would  be 
reduced  if  the  approximation  was  adequate.   This  comparison  was  made 
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for  combinations  of  v=3,5,  A=.05(.05)2,  and  a=. 05 ( , 05) , 30.   These 
values  were  chosen  because  they  are  the  type  of  probabilities  that  need 
to  be  calculated  in  (6.2.1).   The  summation  in  (6.2.4)  was  terminated 
when  the  j    term  was  less  than  10   .   This  turned  out  to  be  between  5 
and  11  terms  in  all  cases  considered. 

For  small  a,  A,  and  v=3,  the  approximation  formula  slightly  over- 
estimates the  probability.   However,  for  v=3,  a-^   .20,  and  large  values 
of  A,  the  approximation  underestimates  the  probability  by  as  much  as 
.01.   For  this  reason,  it  was  decided  to  use  the  computational  formula 
(6.2.3)  in  the  discussion  which  follows. 

Once  again,  a  Fortran  program  was  written  to  conduct  a  grid  search 
for  optimal  designs.   This  was  done  for  N=100  total  comparisons  and  all 
combinations  of  3  ,S_=0(.2)1.   The  entire  procedure  was  repeated  for 
error  rates  a=.01 , . 05, . 10, .15, . 20.   The  optimal  design  minimizes 


2     '^  ^ 

(XX) 


-1 


dx   ,  (6.2.5) 


where  E  is  given  in  (6.2.1).   By  (6.1.1),  y=*'N6^  was  substituted  for  y 
in  (6.2.5).   The  procedure  used  for  each  value  of  a  is  identical  to  the 
one  described  in  the  last  subsection  of  Section  4.2,  except  that  the 
values  of  x  ,  x  ,  and  the  comparison  proportions  were  found  accurate  to 
only  ±.001. 

The  result  of  the  grid  search  was  that  for  6   ^  .2,  the  level 
a=.01  gave  the  smallest  value  for  V.   This  implies  that  it  may  be  best 
to  take  a=0.   This  further  implies  that  a  linear  model  should  be  fit 
regardless  of  the  data.   For  S  ^  .4,    it  appeared  that  it  is  best  to 
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use  a=l,  implying  a  quadratic  model  should  be  fit  regardless  of  the 
data,  and  hence  the  optimal  designs  are  found  in  Section  4.3. 

This  is  a  very  peculiar  result.   It  seems  to  be  implying  that 
there  is  some  value  of  3  ,  say  S>   ^,    in  the  interval  (.2,. 4)  such  that  a 
linear  model  should  be  fit  for  any  |6  |  less  than  S  ^,    and  a  quadratic 
model  should  be  fit  for  any  \S>    \    greater  than  6   .   No  definite  expla- 
nation for  this  phenomenon  is  presently  known. 


CHAPTER  7 
TWO-STAGE  SAMPLING  FOR  MODEL  FITTING 

7.1   Introduction 

Suppose  the  entire  experiment  is  conducted  in  two  stages.   The 
total  number  of  paired  comparisons,  N,  is  then  split  into  two  parts. 
The  first  sampling  stage  has  N  total  comparisons,  and  the  second  has 
N   total  comparisons,  such  that  N  +N^=N.   After  the  first  stage,  the 
hypothesis  H  :   S_=0   is  tested.   If  the  hypothesis  is  rejected,  then 
the  design  of  the  second  stage  would  be  one  which  is  optimal  for  fitting 
a  quadratic  model.   The  quadratic  model  is  then  fit  using  only  the  data 
from  the  second  stage.   If  the  hypothesis  is  accepted,  then  the  second 
stage  would  be  a  design  optimal  for  fitting  a  linear  model,  again  using 
only  the  second  stage  data  for  the  estimation  of  the  linear  model. 

The  first  stage  design,  referred  to  as  Design  1,  is  {n     = 
n     =  . 5N  } .   This  design  was  shown  in  Section  3.3  to  minimize  var(6^) 
for  3  =6  =0.   The  design  was  also  shown  to  be  highly  efficient  for 
|6  I  ^1.   This  is  a  good  choice  for  the  first  stage  design  because  it 
maximizes  the  power  of  the  test  of  the  null  hypothesis  for  a  given 
value  of  N  . 

The  second  stage  design  is  one  of  two  choices  depending  on  whether 

or  not  it  is  decided  to  fit  a  quadratic  model.   If  the  null  hypothesis 

is  rejected,  the  design  for  the  second  stage,  referred  to  as  Design  2Q, 

is  fn   _,  ,  =  n  .  ^,    -    .4rJ  ,  n  ,  ,  =  .2N^}.   This  design  was  shown  in 
-.24,1     -i,.24       2    -1,1      2 
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Section  4.5  to  be  one  of  the  overall  better  designs  for  fitting  a  quad- 
ratic model.   Finally,  if  the  null  hypothesis  is  accepted,  the  design 
{n_    =  N^}  is  to  be  run.   This  design  was  shown  in  Section  3.2  to  be 
optimal  for  minimizing  var(6,),  and  hence  optimal  for  fitting  a  linear 
model.   This  design  is  referred  to  as  Design  2L.   The  following  section 
discusses  optimal  choices  of  the  error  rate  for  the  test  of  hypothesis 
and  the  optimal  values  of  N   and  N   using  a  Bayesian  approach. 

7 . 2   Optimal  Error  Rate 

Two  prior  bivariate  distributions  for  (6^  ,B_)  and  two  optimality 
criteria  are  considered  using  a  Bayesian  approach.   The  prior  distribu- 
tions are  the  uniform  and  normal  distributions,  both  centered  about  the 
point  (0,0).   The  uniform  prior  is  appropriate  if  an  experimenter  could 
state  that  3,  and  g   are  in  some  intervals  centered  about  zero,  but 
with  no  reason  to  believe  that  some  subset  of  values  for  8   and  B   is 
more  likely  than  any  other.   On  the  other  hand,  if  the  person  could 
state  that  S      and  6^  are  in  some  intervals  centered  about  zero,  and 
furthermore  that  it  is  more  likely  that  they  are  near  zero  than  it  is 
that  they  are  far  away  from  zero,  then  the  normal  prior  is  appropriate. 

The  optimality  criteria  considered  are  the  minimization  of  the 
integrated  mean  square  error  and  D-optimality.   These  two  criteria  have 
been  previously  discussed  in  Chapter  4  for  the  case  of  no  bias,  and  are 
also  applicable  for  the  present  situation.   The  difference  between  the 
situation  in  Chapter  4  and  the  situation  in  the  present  chapter  is  that 
bias  can  appear  in  the  present  situation.   That  is,  there  is  bias  pre- 
sent if  a  linear  model  is  fit  when  the  true  model  is  quadratic.   For 
this  reason,  the  mean  square  error  of  the  maximum  likelihood  estimators 
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is  used  in  the  present  chapter  instead  of  the  variance-covariance 

matrix. 

The  decision  rule,  d,  is  a  choice  of  either  the  linear  design  (1) 

or  the  quadratic  design  (q)  for  the  second  stage  of  the  experiment. 

Notice  that  the  decision  rule  is  equivalent  to  choosing  the  error  rate 

for  the  test  of  H  :   6^=0.   For  the  present  section,  the  Saves  rule  is 
o    2 

found  for  fixed  N,  and  N^,  such  that  N,+N^=100. 
12  12 

Define  p  to  be  the  probability  of  rejecting  the  null  hypothesis. 
The  value  of  p  depends  on  6  ,  a,  and  var(B^)  from  the  first  stage.   In 
fact,  it  can  be  shown  that 


1  -  ^(z^)  +  ^(2^)  ,  (7.2.1) 


where 

"l    =    -V2  -  V^^^^^^^))-'  ,  (7.2.2) 

^0   =   2^/0  -  B_/(var(6_))"^  ,  (7.2.3) 

2        a/2     2       2 

and  where  *  is  the  standard  normal  cumulative  distribution  function, 
and  z    is  such  that   (1  -  $(z  ))  =  a.   Because  of  the  symmetry  of  the 
first  stage  design,  by  (3.3.9)  the  standard  error  of  8   is 

(var(32))'^  ^      '^^"\2      "   ^  ^"i*-l  o^^'  ^  ^^1*^0  i/^)'""^  '  (7.2.4) 

where  (|)     and  i1)    are  given  in  (4.2.9). 

Consider  first  the  integrated  mean  square  error  criterion.   The 
loss  function  for  this  criterion  is 

L(8,l)    =   /    MSEdn  TT  )  dx  ,  (7.2.5) 

J 
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L(3.,q)    =       MSEdn  TT  )  dx  ,  (7.2.6) 


where 


6  =   iB^,Q^), 

In  TT  =    S,x  ,  (7.2.7) 

X         1 

In  7T  =    B,x  +  B^x^  ,  (7.2.8) 

X        12 

and  where  B   is  the  maximum  likelihood  estimator  from  Design  2L,  and 

(6, fS  )  is  the  maximum  likelihood  estimator  from  Design  2Q.   The  risk 
function  is  then 


R(6,d)    =    (1  -  p)L(B,l)  +  pL(S,q)  .  (7.2.9) 


The  mean  square  error  of  (S  ,0)  is 


MSE(6  ,0)    =  ,  (7.2.10) 

[     0     s,^i 


where  (^     is  given  in  (4.2.9)  ,  and 


^1*    =    ^V-1,1  '  ^'-'-^^^ 


From  (7.2.5)  and  (7.2.10),  the  loss  when  Design  2L  is  chosen  is 


L(B,1)    =        (X   x   ) 


l/-\,,*      0  \  /  X 


-1  \   0      B.  /  V  > 


I  a. 


11 
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The  mean  square  error  of  (3,/3„)  is 


^/\l 


MSE(6^,B2)    "  '  (7.2.13) 

V  0     1/X22  / 


where  from  (3 . 3. 2) - (3 . 3. 5)  , 


^22    =    ^2^-^^^^*-l,.24  ^'^-.24,1^^  '  ^^"^-^^^ 


-.766   +  1.05766 


■1,.24  3^  -  6^     .246^  +  .05766^   2 

(  e        +  e  ) 


(7,2.16) 


.766   +  1.05766. 


-.24,1  -.246^  +  .057662     ^1+22   2 

(  e  +  e        ) 


(7.2.17) 


and  (p_  is  given  in  (4.3.9).   The  off-diagonal  elements  of  (7.2.10) 

and  (7.2.13)  are  zero  because  both  second  stage  designs  are  symmetric. 
From  (7.2.6)  and  (7.2.13),  the  loss  when  E)esign  2Q  is  chosen  is 

L(6,q)         =  (XX)  dx 

^-l  \        0  l/X22/\x^/ 

=        2Z1     ^      2^      ,  (7.2.18) 

\l  22 

Then  for  the  integrated  mean  square  error  criterion,  by  (7.2.9), 
(7.2.12),  and  (7.2.13)  the  risk  function  becomes 


R(3,d) 


(1  -  P) 


/3  +l6  ' 


\l*   ^^ 


+  p 


2/3    2/5 


The  Bayes  risk  is  defined  to  be 
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(7.2.19) 


r{T,d) 


R(6,d)  dT(6) 


(7.2.20) 


For  the  D-optimal  criterion,  the  loss  function  is 


L(6,l) 


L(S,q) 


1/A^^*    0 


0     3, 


l/X 


11 
0    i/\ 


22 


^  /\i* 


i''\r^22 


(7.2.21) 


(7.2.22) 


Hence  the  risk  function  in  this  case  is 


R(3,d) 


(1  -P)&,A^^^      ^     P/A^^X^^ 


(7.2.23) 


The  two  prior  distributions  are  now  defined.   The  first  prior  is 
the  bivariate  uniform  distribution,  whose  density  function  is 


dT(3) 


1/4U     if  3^£[-l,l],  &^eL-u,u}  , 


otherwise , 


(7.2.24) 


where  U  is  the  upper  limit  to  the  prior  distribution  of  3  • 

The  other  prior  considered  is  the  bivariate  normal  distribution. 
Since  the  support  of  the  normal  distribution  is  infinite,  the  density 
was  truncated  at  three  standard  deviations  about  the  mean  in  order  to 
perform  the  numerical  integration.   The  marginal  densities  are  then 
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-4.5"  2 


dTg_^(6^) 


dx  iB) 

2 


^  /.3334      if  S^eL-1,1], 
otherwise , 


2   2 

e        /2.5a     if  6-£[-U,u], 


otherwise. 


(7.2.25) 


where  a=U/3.   These  marginals  are  the  usual  normal  density  divided  by 
.9974  so  that  the  density  integrates  to  1.   The  joint  prior  distribution 
of  iB    ,Q    )    is  the  product  of  the  marginals. 

The  integral  in  (7.2.20)  can  not  be  analytically  found  for  any 
criterion  and  prior  since  p  is  a  function  of  the  standard  normal  cumu- 
lative distribution,  which  in  turn  is  a  function  of  3_.   So  a  SAS  com- 
puter program  was  written  to  numerically  integrate  (7.2.20)  for  the  two 
prior  distributions  described  in  the  two  preceding  paragraphs  and  the 
two  criteria  discussed  in  the  present  section. 

The  numerical  integration  is  performed  as  follows.   The  rectangle 
formed  by  the  area  of  positive  density  is  divided  into  a  10"  grid. 
This  results  with  100  rectangles  of  equal  size.   The  expression 
R{8_,d)dT{6_)  is  then  evaluated  at  each  of  the  centers  of  the  100  rect- 
angles.  This  gives  the  height  of  the  function  R(3_,d)  dT  (8_)  at  the 
center  of  each  rectangle.   The  lengths  of  the  sides  of  the  rectangles 
are  .02  and  .02U,  and  so  the  approximate  volume  of  each  region  formed 
by  the  function  and  the  sides  of  each  rectangle  is  found  by  multiplying 
the  height  of  the  function  at  the  center  of  the  rectangle  by  .04U.   The 
approximation  of  the  interval  in  (7.2.20)  is  then  found  by  summing 
these  100  volumes. 
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For  each  of  the  four  combinations  of  the  two  prior  distributions 

and  tvro  criteria,  the  Bayes  risk  in  (7.2.20)  was  found  for  N  =10(10)90, 

a=0(.05)l,  and  various  values  of  U.   The  value  of  N  is  found  by 

N  =100-N  .   For  each  value  of  N,  and  U,  the  best  a  level  was  found  from 
2      1  1 

the  choices  0=0 (.05)1.   These  optimal  a  levels  are  graphed  as  a  func- 
tion of  U,  the  upper  limit  to  the  prior  distibution  of  S-,  for  each  of 
N  =10(10)90.   Remember  that  these  graphs  are  not  precise  since  the 
optimal  a  level  is  only  found  to  the  nearest  multiple  of  .05,  but  they 
do  give  a  basic  understanding  for  the  behavior  of  the  a  level  as  a 
function  of  the  prior  distribution  of  6  •   The  graphs  for  the  inte- 
grated mean  square  error  criterion  with  a  uniform  prior  are  found  in 
Figure  7.1,  and  with  a  normal  prior  are  found  in  Figure  7.2.   The  graphs 
for  the  D-optimality  criterion  with  a  uniform  prior  are  found  in  Figure 
7.3,  and  with  a  normal  prior  are  found  in  Figure  7.4.   The  next  section 
contains  a  discussion  of  these  four  figures. 

7 . 3   Concluding  Remarks 

In  Figures  7.1-7.4,  the  axis  labelled  "U"  corresponds  to  the  upper 
limit  of  the  prior  distribution  of  6  .   The  U-axis  in  the  graphs  for 
the  normal  prior.  Figures  7.2  and  7.4,  ranges  up  to  2.08.   The  normal 
prior  with  U=2  corresponds  to  3   having  a  normal  distribution  with  mean 
0,  and  standard  deviation  2/3.   The  U-axis  of  the  graphs  for  the  uni- 
form prior.  Figures  7.1  and  7.3,  ranges  up  to  1.2.   It  is  likewise  true 
that  for  the  uniform  distribution,  U=1.2  implies  that  the  standard 
error  of  3   is  also  approximately  2/3.   So  for  a  given  amount  of  varia- 
bility, the  upper  limit  for  the  normal  prior  is  approximately  1.7  3  times 
the  upper  limit  for  the  uniform  prior. 
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For  example,  if  an  experimenter  believes  Q      is  somewhere  in  the 

interval  (-.5,. 5),  but  has  no  inclination  to  where  in  that  interval  6 

2 

is,  then  a  uniform  prior  would  be  appropriate.   Figure  7.1  indicates 
that  for  U=.5  and  N  =10,  the  test  should  be  run  at  an  error  rate  of 
approximately  a=.20;  for  N  =20,  a=.08.   A  normal  prior  with  the  same 
amount  of  variability  or  uncertainty  would  be  found  by  multiplying  U=.5 
by  1.73.   This  results  in  U=.865.   Figure  7.2  indicates  that  for  U=.865 
and  N  =10,  the  test  should  be  run  at  an  error  rate  of  approximately 
a=.35;  for  N  =20,  a=.20. 

So  the  error  rates  for  the  particular  value  of  the  standard  error 
of  3   discussed  in  the  preceding  paragraph  appear  to  be  slightly  larger 
for  the  normal  prior  than  for  the  uniform  prior.   However,  this  is  not 
apparent  for  the  entire  range  of  values  for  U  and  N  .   In  fact,  by 
looking  at  the  maximum  value  of  U  in  Figxires  7.1  and  7,2,  a=l  in  both 
cases  for  N  =10,20,30,  but  a  is  larger  for  the  uniform  prior  than  for 
the  normal  prior  when  N  =40(10)80.   For  most  values  of  the  standard 
error  of  S_,  and  N  ,  in  particular  when  the  standard  error  is  relatively 
large,  a  is  larger  for  the  uniform  prior  than  for  the  normal  prior. 

Notice  from  all  four  figures  that  for  a  given  value  of  U  and  N  , 

the  a  level  for  the  normal  prior  is  smaller  than  for  the  uniform  prior. 

This  is  partially  explained  by  the  previous  paragraph.   The  normal 

prior  with  the  same  value  of  U  as  a  uniform  prior  will  have  a  smaller 

standard  error,  and  most  of  the  density  is  near  3^=0.   Consequently, 

there  is  a  higher  probability  that  3^  is  near  zero,  and  it  is  therefore 

reasonable  that  the  hypothesis  H  :   3^=0   should  be  tested  at  a 

o    2 

smaller  a  level. 
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Comparing  the  two  criteria  for  each  of  the  two  priors  indicates 
that  for  given  values  of  U  and  N  ,  the  a   level  is  smaller  for  the 
D-optimal  criterion  than  it  is  for  the  integrated  mean  square  error 
criterion. 

It  turns  out  that  in  all  four  situations,  for  a  given  value  of  U, 
the  Bayes  risk  is  smaller  for  N  =10  than  it  is  for  any  of  N  =20(10)90. 
This  indicates  that  if  an  experimenter  is  interested  in  rionning  a  two- 
stage  experiment,  a  relatively  small  number  of  comparisons  should  be 
used  in  the  first  stage,  saving  the  majority  of  the  available  compari- 
sons for  the  second  stage.   This  may  be  explained  by  the  fact  that  in 
the  present  discussion,  the  first  stage  data  are  not  used  in  the  estima- 
tion phase.   Only  the  second  stage  data  are  used  for  the  final  estima- 
tion.  So  the  result  found  at  the  beginning  of  the  present  paragraph 
implies  that  it  is  better  to  use  the  large  majority  of  the  available 
comparisons  for  the  sole  purpose  of  testing  the  null  hypothesis. 

Further  research  remains  to  be  conducted  on  combining  the  first 
and  second  stage  data  in  the  estimation  phase.   This  would  involve 
deriving  vardn  tt  )  ,  where  In  tt   is  expressed  as 

~      ~   2 
In  ^    =   1(3, X)   +   (1  -  I) (3,x  +  &K   )    , 
X  1  12 

and  where  I  is  the  decision  rule  for  the  first  stage,  i.e. 


r  1    if  it  is  decic 


Lded  to  fit  a  linear  model, 
I   =  { 

(_  0    if  it  is  decided  to  fit  a  quadratic  model, 


This  is  not  a  trivial  problem  because  the  random  variables  I,  B  ,  and 
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(3,/8„)  are  not  independent.  Intuitively,  if  this  could  be  resolved, 
it  appears  reasonable  that  some  optimal  ratio  N  /N  and  a  level  could 
be  found . 
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APPENDIX  A 

COMPUTER  PROGRAM  THAT  FINDS 

MAXIMUM  LIKELIHOOD  ESTIMATES  OF  7T,  ,  .  .  .  .TT  ,9 

1'      t 

This  appendix  contains  a  computer  program  written  in  the  language 
APL.  There  are  two  matrices  which  need  to  be  entered  onto  the  comput- 
er.  First  of  all,  the  matrix  referred  to  as  "N"  is  a  t^t  matrix,  with 

(i,j)    element  equal  to  the  number  of  times  treatment  T.  is  oref erred 

1 

over  treatment  T..   The  other  matrix  is  also  txt,  and  is  referred  to  as 

"TIE".   The  lower  triangular  part  and  the  main  diagonal  of  "TIE"  are 

all  zeroes.   The  (i,j)    element,  where  i<j ,  is  the  number  of  ties 

between  T.  and  T . . 
1       3 

The  output  is  the  following. 


(1)  The  initial  estimates  and  subsequent  iterative  estimates  until 
all  estimates  have  sufficiently  converged. 

(2)  The  asymptotic  variance-covariance  matrix  of  /r^(6  -  9)  , 

vr{Tr^  -  t:^)  ,  ...  ,/'r(Ti   -  tt  )  ,  where  r  is  the  number  of  repli- 
cates for  each  pair.   (Note  that  this  will  not  be  applicable  if 
some  pairs  are  compared  much  more  often  than  others.) 

(3)  The  average  number  of  replicates  per  pair  (r) . 

(4)  The  asymptotic  variance-covariance  matrix  of  9,tt  ,  ...  ,ir   under 
the  assiomption  that  each  pair  of  treatments  is  compared  r  times. 

(5)  The  asymptotic  chi-square  test  of  the  equality  of  t:  ,  .  .  .  ,tt  . 
The  output  includes  the  chi-square  statistic  and  the  degrees  of 
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freedom. 

If  there  are  no  ties,  only  (1)  and  (5)  above  are  printed,  because  in 
this  case  the  calculation  of  the  element  of  the  inverse  to  the  variance- 
covariance  matrix  corresponding  to  9  results  in  division  by  zero. 

An  iterative  procedure  is  used  in  the  estimation  phase  of  the 
computer  program.   The  initial  estimates  of  9,TT  ,  ...  ,7T   are  the  ones 
presented  by  Dykstra  (1956) .   The  method  used  to  find  the  estimates  and 
asymptotic  variance-covariance  matrix  was  presented  by  Rao  and  Kupper 
(1967) .   In  their  presentation,  it  was  assumed  that  each  pair  was  com- 
pared an  equal  number  of  times.   Therefore,  as  pointed  out  above,  the 
variance-covariance  matrices  given  by  the  program  may  not  be  applicable 

if  the  pairs  are  not  compared  an  equal  number  of  times. 

T^+.  Q(k)  1    (k)       "  (k)  ,    ^      .  th 

Let  y    ,TT^    ,  ...  ,Tr     be  the  estimates  after  the  k   itera- 
tion.  The  iterative  procedure  is  terminated  when 


(k-1)  _  ^(k) 


(k-1) 


1  +  t 


i=l 


;  (k)  ^  ;  (k-1) 

1       i 


:  (k-1) 


<    10 


-4 


If  so  desired,  this  can  be  changed  simply  by  altering  line  [13  J. 


Example.   Suppose  that 


N   = 


0   40   20 

0    0   40 

14    0    0 


TIE   = 


0  3  5 
0  0  1 
0    0    0 


Then  an  execution  of  the  program  yields  the  following; 
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Initial  estimates 

Final  estimates 
(19  iterations) 


1.0789 

.5724 

.3236 

.1040 

1.1510 

.7267 

.2091 

.0641 

Variance-covariance  matrix  of  /r(9 


))  ,/r(-iT   -  TT  ) 


t    t 


209696 

.022594 

-.012075 

-.010519 

022594 

.136691 

-.103543 

-.033148 

012075 

-.103543 

.088575 

.014968 

010519 

-.033148 

.014968 

.028699 

Average  number  of  replicates:   r  =  39.5 


Variance-covariance  matrix  of  6,tt  , 


,1T   is  approximately; 


.005309 
,000572 
,000306 
,000266 


.000572 

.003461 

-.002621 

-.000839 


-.000306 

-.002621 

.002242 

.000379 


,000266 
,000839 
,000379 
,000727 


Chi-square  test  of   H  :   tt   =  •  .  .  =  tt  : 
o     1  t 


X  =  57.97  ,     degrees  of  freedom  =  2. 
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APPENDIX  B 

COMPUTER  PROGRAMS  THAT  FIND 

MAXIMUM  LIKELIHOOD  ESTIMATES  OF  S, ,...,8 

1       S 

This  appendix  contains  two  computer  programs  that  find  iterative 
estimates  of  S  ,  ...  ,S  .   The  first  one,  found  on  pages  174  and  175 
is  written  in  the  language  APL.   The  second  one,  found  on  pages  176  and 
177,  is  written  in  Fortran.   The  APL  version  is  discussed  first. 

The  input  is  the  following, 

(1)  DATA  =  A  t^t  matrix  whose  (i,j)    element  is  the  number  of  times 
T.  is  preferred  over  T.. 

(2)  MODEL  =  A  vector  of  integers  defining  the  model  which  is  to  be 
fit.   This  is  now  explained  in  detail.   Suppose  there  are  v 
independent  variables  in  the  experiment.   Then  the  first  v  ele- 
ments of  MODEL  give  the  order  of  each  variable  (e.g.  3  means  to 

2        3 
include  x.,  x.  ,  and  x.  ).   The  remaining  elements  are  considered 
111  ^ 

in  pairs,  and  correspond  to  two-way  interaction  terms  which  are 
to  be  included  in  the  model  (e.g.  (1,3)  occurring  after  the 
first  V  elements  means  that  the  term  x  x   should  be  included). 
Notice  that  any  3-order  or  higher  order  terms  can  not  be  included 
without  a  modification  of  the  program. 

(3)  X  =  A  t^v  matrix  of  levels  in  the  experimental  design. 
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The  output  is  the  following. 


(1)  A  listing  of  the  vector  MODEL. 

(2)  The  txs  matrix  X  formed  by  concatenating  onto  X  the  columns 
corresponding  to  the  higher  order  and  interaction  effects. 

(3)  The  sxtxt  matrix  where  the  (i,j,k)    element  is   (X) ..  -  (X),  .. 

31      ki 

(4)  The  parameter  estimates  at  each  iterative  step  until  the  conver- 
gence criterion  is  met.   The  initial  estimates  are  6,='''=6  =0. 

Is 

These  estimates  at  each  iteration  are  printed  in  the  same  order 
as  the  columns  of  X. 


The  Newton-Raphson  method  with  a  slight  modification  is  used  to 

perform  the  iteration  phase.   See  Scarborough  (1962)  for  a  thorough 

discussion  of  the  Newton-Raphson  method.   Springall  stated  that  the 

iterative  estimates  of  8,3,/  ...  ,3   converged  ver^/  slowly.   This  is 

Is 

also  true  when  only  estimating  3,/  ...  ,3   using  the  Newton-Raphson 
method  without  any  modifications.   However,  it  is  the  author's  experi- 
ence that  when  the  convergence  is  slow,  it  is  because  the  estimates  are 
"j\imping"  from  one  side  of  what  will  be  the  final  estimates  to  the 

other.   That  is,  if  3,,  ...  ,3   represent  the  final  estimates,  then  the 
1        s 

estimates  after  the  k   iteration  may  be  3  +£, ,  ...  ,3  +£  t    and  the 

11        s   s 

St  ^ 

estimates  after  the  (k+1)    iteration  may  be  approximately  8  -£w  ...  , 

3  -£  ,  for  some  values  of  Z.,    i=l,  ...  ,s.   Because  of  this  phenomonen, 
s   s  1 

the  modification  to  the  Newton-Raphson  method  is  to  take  the  average  of 
the  k"   and  (k+1)    iterative  estimate  before  continuing  with  the  next 
iteration  whenever  the  direction  of  convergence  changes.   For  example, 

St 

if  the  successive  estimates  of  3   are  decreasing,  and  the  (k+1) 
estimate  of  3^  is  larger  than  the  k   ,  then  the  average  of  the  k   and 
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St  st 

(k+1)    estimate  replaces  the  (k+1)    estimate  before  proceeding  to  the 

(k+2)    iteration.   This  modification  substantially  decreased  the 

number  of  iterations  until  convergence. 

The  iteration  phase  is  terminated  when  the  maximum  difference 
between  the  estimates  and  the  preceding  estimates  is  less  than  10 
If  it  is  desired,  this  can  easily  be  changed  by  altering  line  [55]. 

As  pointed  out  in  Section  2.2,  the  procedure  does  not  always 
converge.   However,  the  only  time  this  occurred  was  when  it  was 
attempted  to  fit  a  full  model,  i.e.  when  s=t-l.   When  s=t-l,  the  pro- 
gram in  Appendix  A  can  be  used  to  find  estimates  of  In  tt  .  ,  and  then  the 
t  equations, 


t-1 


In  TT 


1       ,/_,   k  ki 


i=l, . . . ,t, 


k=l 


can  be  solved  for 


,B 


t-l 


Example .   Suppose  that 


DATA  = 


0 

10 

6 


15 

0 

11 


19 

14 
0 


MODEL   =   [2  J 


Then  an  execution  of  the  program  yields  the  following: 


MODEL  =   2 


.X   = 


Matrix  of  differences; 


0  -1 

1  0 

2  1 


-2 

-1 
0 


1     0 

0  -1 

1  0 
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Iteration     6,,S  ,... 

1  -.468182  -.145455 

2  -.485958  .319043 

3  -.469350  -.144161 
AVG  -.477654  .087441 


11       -.478947     .084719 


As  can  be  seen  in  the  iterative  phase  in  the  example,  an  average 
is  taken  between  the  3   and  4   iteration.   This  occurred  because  3, 
decreased  and  6-  increased  from  the  1   to  the  2    iteration,  while  the 
reverse  occurred  for  the  2   to  the  3    iteration. 

The  Fortran  program  as  it  currently  stands  can  only  be  used  for 
fitting  a  quadratic  model.   It  can,  however,  be  modified  to  be  as 
general  as  the  APL  program.   The  matrices  DATA  and  X  need  to  be  read 
in.   This  is  done  in  line  numbers  3-8.   These  statements  in  addition  to 
the  data  itself  at  the  end  of  the  program  will  need  to  be  changed 
according  to  the  problem  at  hand. 

A  peculiar  occurrence  was  made  evident  by  running  the  Fortran 
program  for  the  same  example  as  presented  above.   It  turned  out  that 
the  Fortran  program  converged  to  the  same  final  estimates  in  only  4 
iterations  instead  of  11  iterations.   The  procedure  in  each  program  is 
the  same,  but  no  explanation  for  the  difference  in  the  speed  of  con- 
vergence for  the  two  programs  is  presently  known. 
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€21 
r.Z2 
LAI 
Z51 
l61 
Z71 
C31 
C?l 

i:  1 0  J 
cm 

11123 
C13a 

i:  1 4  3 
C15: 

C161 
C173 
1131 
Ci?l 
L201 

i::2in 

l22] 
1:23: 

i::24  3 

C25: 
C263 

:27j 

C28D 
C293 
C30] 
C31J 
C32J 
C33J 
C34a 
C35D 
C36: 
C37: 
C33: 
C393 
C40  3 
1:413 
L'42n 
C433 

C443 
C453 


,T,  (T^f  ;-;[:;i3)  );^Q 


7  MOr.EL.  ESTIM  >' J  I  J  J  ;  T  J  K  ;  M  ATR  I  K  J  XD  I  FF  J  3  J  I  TEP:  ;  P  ;  P  ^  ;  P  2  ?  F-3  5  COP:  ; 
D  ;  DETERM  ,*  L  J  N  ;  BETftOLD  ;  DIFFOLI'  J  D  IFF  J  FLAG  J  l_UL. 
BETA<-(l,pX[:m)fO 

'■f^F'<Li;i 
"-1:^(1  0  =i<H)/L2,i-5 
U2:i<-i  +  i 

->(1  0  =*^'^J:'e:i-Ci:il)/i-i,L.3 

'-3:«^i 

-»(1  0  =K  <MOr.El.Ci3  )/L.4,l_5A 
'-5«;-:'(l   0  =I=N)/1-5,L.2 
^5:-^(l   0  =H=pMaDEU  ) /Tl  ,  L^ 

1-6:  it-i+2 
;;^x,;-;c  ;  model-c  i_i  j  3  xxc  ;Mor'ELj:i33 

->(1      0     =1  </"  MODEL  )/U6,  Tl 

Ti:'  MODEL    =     ' ;model 

□<- '  '  ;Dt- '  ' ; '  X   =  ' 

□<- '  '  ;d<-  '  '  ;•-< 

>cr.iFF^(  (S^/-;;[:i;3 

T2: i^i+i 
^3:-'<-'-'+i 

;cr.iFF[:;i;  j:^KCi;:--C^f  3 
xr.iFFr;  jji-]^_v;i:,iFFc;  i;  j: 

4(1      0     =-!<  T)/T3,  T4 

T4M(1      0     =I<  (T-i)  )/T2,T5 

D<- '  '  ;n<- '  '  ?;;diff 

MATRi;;^  (   (  5  ,  T  ,  T  )  ^-DATA  )  x>.'DIFF 
FLAG<-ITEP:t-0 

n*- '  '  r n<- '  '  ;d<-  '  '  ;a<- '  '  ;  '  itef.ation 

COF.>.(  1  ,S)j.-0 
To  :  P'f-  t&ETA+  ,  xi^X 
!=■  1  ^  C  T  f  T  )  f  ,  F- 
f^^^-CjFl 

F-3«-'='l-p'l+p-2 

EaNSf._  +  /  +  /MATF:I>;x  (  S  ,  T  ,  T  )  ;.•>  F-3 

D<-(3,S)/.0 

WAT*-(5,5,5)^0 

T7;l<-l  +  i 
E'C  ;  L3^  +  /  +  /MATF:i;;x  (  5  ,  T  ,  t  ),-«((  t  ,  T  ),■>;■;[:;  lj  )  xF  3-  (  Fl  x  ( Sj  ((  r  ,  t  )  ,^KC 
;  "-  3  )  X  F- 1  )  +  (  (  T  ,  T  )  ;.->  ;.r  c  ;  L  3  )  X  F-  1  )  -  (  F- 1  +F-2  )  «  2 
MAT[:;;L:3f.(S.S)fD[:;L3 

MATCL  ;    :  L]<-EQ?-!S 


OF  DIFFERENCES 


&0' ^1 f B2 
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1146: 
C472 
C481 
C49: 
C503 

C5in 

C521 
C533 
C54a 
C55] 
C563 
C57J 
C53: 
C593 
12601 
£612 
C62J 
C63: 

i:64: 

l6oI] 
C66j 
1:67  J 
CoSj 
C693 
C70  3 
l712 
C723 
C733 
C74J 
1:733 


->(1     0     =L.<3)/T7,TB 
Tg  ;  riETERM^-DET     D 

T9:i<.i  +  i 

COR  CI  ;  X]t-(DET     MflTCI  ;  ;  3  )-^DETEF:M 

4(1   0  =I<5)/T9.»T10 
TIQ  J  ITER^-ITER  +  l 

2<ETflOLr><-BETA 

BETftf-BETA  +  COR 

'  I5f-5»30f^l0,6  '      D>="MT(  (  1  ,S+1  )p  ITER,  BETA) 

-*(1      0     =<  r/  I  BETA-BETAOUP)  <  lE-.5)/T12,Tll 
Tlir-^d     0     =ITER<50)/T11A,0 
"fll«:->(l      0     =f=">-AG  =  0)/TllB,TllC 
TUB  :  FLAG<-1 

"'"ll'^WCl      0     ='="1-'^G=1)/T11D,T11E 
TllDJ  tiIFFOl_r><-BETA-BETAOl-D 
F-UAGf.2 

TllE:DIFF*-BETA-&ETAOl_r' 

AAAJL.i_l_<-Ll.l_+j^ 

•^(1      0     =<  (  xr.IFFCl  ;i.I_1.3  )=xDIFFOI_riCl  ;i-l_l_:]  )  ) /BBB,  TllF 
&&B;-*(1      0     =1-1-I_  =  5)/T1XG,  AAA 

TllF;BETA«-(BETA+&ETAOI_r') -f-2 

'    «'''G    •  ;  •  ;;5,30f^io,6 '    ni^wf  c  ( i ,  5)f  e<eta) 

F1_AG<-1 
TllG'DIFFOLIif-r'IFF 

■''12:'         CONVERGENCE  CRITERION  MET' 
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DIMENSION  DATA(5,5)  r  XDIF  F  (  2  f  5  .  3  )  ,  XDIFFM  (  2  ,5..  5  )  rP(5)  rPRATI0(5r5)  I 
lX(5f 2) > BETA (2) r D(2>2) f«AT( 100^3) 
READ(5f 100) ( (DATA(I» J) f J=l ,3) f 1=1 f 3) 

100  FORMAT ( 12F2.0) 

WRITE  C6f  101)  (  (DATAdf  J)  rJ=l,3)»I  =  lf3) 

101  F0RMAT(20Xf ' DATA ' ///3 ( 3F6 , 0// )  ) 
READ (5f 102) (X(I»1),I=1,3) 

102  FORMAT (3F2.0) 
DO  1  1=1,3 

1  Xdf  2)=X(I,1)**2 
DO  2  1=1,2 

DO  2  J=lf3 
DO  2  K=lf3 

2  XDIFFd,  J,K)=X(  J,I)-X(K,  I) 
WRITE(6»103)((X(I,J),J=l,2)»I=lf3) 

103  FORMAT ( '1' f20X, ' X ' ///3 ( 2F6 . 1// )  ) 

URITE(6f 104) ( ( (XDIFFC I , Jf K) f K=l,3) , J=lf 3) ,1=1. 2) 

104  FORMAT ( '1' f20Xf ' XDIFF ' ///3 ( 3F6 . 0// ) ///3 ( 3F6 , 0// ) ) 
BETA (1) =0.0 

BETA(2)=0.0 

CALL    ESTIM(DATAf3rl00dTERfX,XDIFF.BETAf D.DETfMATfM) 

WRITE(6,105)ITERf BETA( 1) r BETA (2) 

105  FORMATC '1' rlOXr 'NUMBER  OF  ITERATIONS ' //15X d6//20X ,' BETA ' /// 
12F15.6) 

UR I TE ( 6 . 1 06 ) DET  f  D ( 1 f 1 ) T  D ( 1 f  2 ) f  D ( 2  r 1 ) . D ( 2  »  2 ) r 
1 ( (MATCIf J) r J=l »3) f 1=1 »M) 

106  FORMAT (  ' 1' f lOX , F15 . 6//4F20 . 6////100 ( /3F20  .  6  )  ) 
STOP 

END 

SUBROUTINE  ESTIM(DATAf IITfNITERrlTERf XfXDIFFf BETAf D^DET.MATfM) 
DIMENSION  DAT A (5. 5) , XDIFF ( 2 f 5 , 5 ) , XDIFFM ( 2 f 5 f 5 ) , P ( 5 ) . D ( 2 r 2 ) , 
lPRATI0<5f 5) ,X(5,2) f BETA(2)  .BOLD (2)  .D0LD(2) f DIFF(2) rMAT( 100,3) 
DO  1  1  =  1  f 2 
DO  1  J=lrIIT 
DO  1  K=lfIIT 

1  XDIFFM( I , J,K)=DATA( JtK)*XDIFF( I , J.K) 
M  =  0 

ITER=0 
IFLAG=0 
10  DO  2  1  =  1 T I  IT 

2  P( I)=EXP(BETA( 1 )*X( Ir 1 )+BETA(2)*XCI,2)  ) 
M=M+1 

MAT(M» 1 )=FLOAT( ITER) 

MAT(Mr2)=BETA( 1 ) 

MAT(M.3)=BETA(2) 

FUNC1=0.0 

FUNC2=0.0 

DO  3  1  =  1  f  I  IT 

DO  3  J=lfIIT 

PRAT 1 0 (I , J ) =P ( J ) / ( P (I ) +P ( J  )  ) 
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4 
44 


11 


14 


16 


//GO, 
0151 
-1    0 


FUNC1=FUNC1+XDII-FM(1  r  I  f  J  )  *PRATIO  (I  ?  J  ) 

FUNC2=FUNC2+XDIFFM(2f Ir J)*PRATIO(rr J) 

DO    44    IR=lf2 

DO    44    L=1j2 

DD=0.0 

DO    4    I=lfIIT 

DO    4    J=lfIIT 

IFd.EQ.  J)    GO    TO    4 

DD  =  DD  +  XD IFFM ( IR  ^ I »  J ) * ( X ( J  »  L) *PRAT 10 ( I f  J  )  - 
l(X(IfL):<cPRATIO(I»  J)>KPRATIO(  J.I)+XC  JrD^PRATIOdf  J)**2)  ) 

CONTINUE 

D(IRfL)=DD 

DET=D(lf l)*D(2f2)-D(lf2)*D<2»l) 

ITER=ITER+1 

B0LD(1)=&ETA(1> 

B0LD(2)=BETA(2) 

BETA ( 1 ) =BETA (1 )  +  ( FUNC2*D ( 1 f  2 ) -FUNCl *D ( 2  f  2 ) ) /DET 

BETA ( 2 ) =BETA ( 2 ) + ( FUNC1*D (2^1) -FUNC2*D ( 1 r 1 ) ) /DET 

DO  5  1  =  1  f 2 

DIF  =  ABS(BETA(I)-BOLD(r  )  ) 

IF(DIF,GT. .000001)  GO  TO  11 

CONTINUE 

RETURN 

IFCITER.GE. NITER)  RETURN 

IF(IFLAG»EQ.2)  GO  TO  14 

IF( IFLAG.EQ.l)  GO  TO  13 

IFLAG=1 

GO  TO  10 

DGLD ( 1 ) =&ETA ( 1 ) -BOLD ( 1  ) 

DOLD  C  2 ) =BETA ( 2 ) -BOLD ( 2 ) 

IFLAG=2 

GO  TO  10 

DIFF(1)=BETA(1)-B0LD(1) 

DIFF(2)=BETA<;2)-B0LD^2) 

IF(SIGN(DIFF(1) »D0LD(1) ) .NE.DIFF(l)  )  GO  TO  15 

IF(SIGN(DIFF(2) f D0LD(2)  )  .EQ.DIFF(2)  )  GO  TO  16 

BETA( 1 )=<BETA( 1)+B0LD(1) )/2. 

BETA(2)=(BETA(2)+B0LD(2) )/2. 

M  =  M  +  1 

MAT';,^»  1)=-1 

MAT<Mt2)=BETA(1) 

hAT(Mf 3)=BETA(2) 

IFLAG=1 

DOLD (I )=DIFF(1) 

D0LD(2)=DIFF(2) 

GO  TO  10 

END 
SYS IN  DD  * 
910  014  611  0 
1 
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